-- Logs begin at Sun 2022-09-11 07:53:43 UTC, end at Sun 2022-09-11 09:08:34 UTC. -- Sep 11 08:37:46.003718 dv-cinder-856941-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 11 08:37:46.014086 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 08:37:46 2022] *** Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: nodename: dv-cinder-856941-2-iscsi Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: machine: x86_64 Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: clock source: unix Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: pcre jit disabled Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: detected number of CPU cores: 4 Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: current working directory: / Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: detected binary path: /usr/bin/uwsgi-core Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: your processes number limit is 47680 Sep 11 08:37:46.017131 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: your memory page size is 4096 bytes Sep 11 08:37:46.018243 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: detected max file descriptor number: 2048 Sep 11 08:37:46.018243 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: lock engine: pthread robust mutexes Sep 11 08:37:46.018243 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: thunder lock: enabled Sep 11 08:37:46.018243 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 11 08:37:46.018243 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 08:37:46.057018 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: Python main interpreter initialized at 0x56382cfd39c0 Sep 11 08:37:46.057018 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: python threads support enabled Sep 11 08:37:46.057018 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: your server socket listen backlog is limited to 100 connections Sep 11 08:37:46.057018 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: your mercy for graceful operations on workers is 90 seconds Sep 11 08:37:46.057541 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 08:37:46.057541 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: *** Operational MODE: preforking *** Sep 11 08:37:46.057754 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: *** uWSGI is running in multiple interpreter mode *** Sep 11 08:37:46.057754 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: spawned uWSGI master process (pid: 112602) Sep 11 08:37:46.057908 dv-cinder-856941-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 11 08:37:46.059057 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: spawned uWSGI worker 1 (pid: 112603, cores: 1) Sep 11 08:37:46.059057 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: spawned uWSGI worker 2 (pid: 112604, cores: 1) Sep 11 08:37:46.059057 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 08:37:46.725265 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 08:37:46.777670 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 08:37:47.822502 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:37:47.822502 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: from cryptography.utils import int_from_bytes Sep 11 08:37:47.823135 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:37:47.823135 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: from cryptography.utils import int_from_bytes Sep 11 08:37:47.863094 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:37:47.863094 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: from cryptography.utils import int_from_bytes Sep 11 08:37:47.863665 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:37:47.863665 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: from cryptography.utils import int_from_bytes Sep 11 08:37:50.359446 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 08:37:50.360207 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 08:37:50.360207 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 08:37:50.360564 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 08:37:50.360812 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 08:37:50.360987 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 08:37:50.361419 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.361521 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 08:37:50.361605 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.361764 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 08:37:50.361872 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.362089 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.362288 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 08:37:50.362382 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 08:37:50.362468 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.362729 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.362823 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.363042 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.363142 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.363353 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.363446 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.363664 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.363760 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.363915 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.364011 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.364222 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.364317 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.364537 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-2-iscsi {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.364637 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.364849 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.364936 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.365148 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.365236 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.365413 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.365528 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.365721 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.365811 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.366027 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.366122 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-2-iscsi {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.366368 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.366462 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.367234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.367343 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.367608 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.367794 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.367908 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369129 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369240 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369312 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369383 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369459 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369540 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369540 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369674 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369750 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369822 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369900 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.369973 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.370039 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.370180 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.370316 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.370497 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.370639 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.370813 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.371006 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.371195 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.371412 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-2-iscsi {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.371615 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.371795 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.371972 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.372149 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.372338 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.372519 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.372687 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.372827 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.373036 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-2-iscsi {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.373207 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.373355 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.373524 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.373709 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.373924 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.374205 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.374416 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.374693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.374915 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.375145 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.375400 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.375608 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.375807 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.376002 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.376146 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.376273 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.376405 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.376561 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.376687 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.376808 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.376926 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.377032 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.377032 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.377239 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.377353 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.377458 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.377574 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.377680 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.377792 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.377896 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.378000 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.378104 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.378253 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.378362 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.378466 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.378576 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.378688 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.378803 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.378916 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.379021 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.379181 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.379306 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.379436 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.379578 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.379709 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.379833 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.379956 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.380078 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.380210 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.380210 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.380453 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.380669 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.380805 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.380939 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.381074 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.381187 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.381303 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.381415 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.381583 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.381708 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.381886 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.382023 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.382830 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.382964 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.383087 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.383224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.383347 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.383469 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.383630 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.383755 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.383941 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.384084 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.384241 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.384408 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.384558 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.384748 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.384862 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.385131 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.385253 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.385360 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.385536 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.385650 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.385768 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.385983 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.386097 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.386322 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.386437 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.386641 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.386870 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.386999 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.387121 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.387244 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.387367 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.387592 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.387726 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.387893 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.388028 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.388193 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.388321 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.388490 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.388634 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.388801 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.388928 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.389117 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.389250 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.389414 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.389542 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.389665 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.389787 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.389941 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.390068 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.390265 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.390395 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.390577 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.390799 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.390941 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.391066 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.391197 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.391327 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.391451 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.391574 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.391725 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.391852 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.392023 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.392151 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.392320 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.392448 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.392617 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.392740 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.392916 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.393115 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.393249 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.393422 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.393556 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.393723 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.393859 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.394066 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.394242 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.394377 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.394510 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.394687 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.394815 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.394989 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.395121 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.395286 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.395417 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.395583 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.395711 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.395880 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.396008 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.396175 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.396314 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.396472 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.396608 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.396815 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.396947 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.397077 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.397199 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.397332 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.397455 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.397633 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.397760 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.397955 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.398087 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.398284 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.398418 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.398583 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.398721 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.398880 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.399006 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.399178 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.399312 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.399473 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.399599 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.399771 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.399899 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.400063 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.400195 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.400361 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.400488 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.400659 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.400874 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.401081 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.401192 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.401296 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.401407 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.401512 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.401625 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.401802 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.401917 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.402096 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.402246 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.402418 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.402543 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.402713 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.402836 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.403007 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.403121 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.403298 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.403419 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.403608 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.403721 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.403914 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.404033 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.404212 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.404330 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.404512 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.404633 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.404808 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.404922 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.405119 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:37:50.405233 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.405445 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.405562 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.405767 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.405892 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.406093 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.406254 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.406424 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.406550 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.406743 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.406892 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.407050 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.407187 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.407359 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.407480 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.407666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.407800 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.407967 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.408092 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.408272 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.408401 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.408588 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.408754 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.408879 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.409008 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.409159 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.409307 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.409472 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.409620 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.409784 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.409903 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.410107 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.410285 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.410439 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.410584 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.410748 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.410883 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.411130 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.411274 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.411407 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.411539 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.411670 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.411792 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.411967 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.412093 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.412280 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.412409 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.412610 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.412755 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.412910 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.413048 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.413249 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.413407 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.413609 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.413753 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.413876 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.413997 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.414198 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.414330 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.414508 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.414647 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.414818 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.414951 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.415123 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.415260 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.415425 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.415594 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.415719 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.415851 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.416032 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.416248 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.416383 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.416506 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.416629 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.416760 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.416931 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.417058 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.417233 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.417360 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.417534 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.417668 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.417834 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.417960 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.418134 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.418312 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.418448 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.418585 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.418772 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.418899 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.419080 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.419207 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.419385 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.419579 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.419759 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.419920 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.420086 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.420214 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.420351 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.420481 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.420604 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.420859 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.421080 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.421358 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.421534 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.421660 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.421794 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.421926 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.422058 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.422203 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.422343 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.422468 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.422597 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.422720 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.422851 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.422987 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.423170 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.423300 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.423496 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.423668 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.423852 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.424026 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.424194 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.424406 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.424551 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.424702 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.424830 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.425003 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.425134 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.425299 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.425427 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.425610 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.425739 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.425912 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.426045 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.426249 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.426353 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.426574 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.426688 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.426877 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.427101 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.427294 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.427479 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.427606 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.427776 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.427905 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.428077 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.428204 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.428384 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.428510 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.428686 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.428814 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.429549 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.429686 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.429857 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.430017 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.430227 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.430394 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.430574 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.430780 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.430973 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.431160 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.431372 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.431636 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.431809 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.431979 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.432147 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.432147 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.432490 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.432673 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.432850 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.433019 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.433185 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.433367 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.433552 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.433738 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.433917 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.434106 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.434313 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.434503 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.434670 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.434835 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.434997 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.435170 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.435329 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.435470 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.435595 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.435753 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.435878 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.436000 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.436135 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.436267 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.436398 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.436522 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.436644 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.436769 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.436967 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.437101 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.437214 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.437342 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.437465 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.437587 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.437720 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.437843 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.437966 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.438087 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.438262 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.438386 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.438521 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.438646 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.438768 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.438890 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.439012 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.439142 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.439273 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.439396 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.439518 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.439640 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.439761 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.439891 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.440015 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.440137 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.440259 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.440393 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.440525 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.440659 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.440783 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.440935 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.441072 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.441239 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.441372 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.441542 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.441759 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.441887 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.442008 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.442137 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.442293 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.442452 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.442579 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.442757 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.442884 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.443059 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.443193 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.443364 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.443489 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.443660 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.443785 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.443967 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.444102 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.444279 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.444403 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.444578 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.445333 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.445461 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.445593 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.445783 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.445900 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.446103 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.446241 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.446425 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.446542 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.446729 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.446831 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.447031 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.447157 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.447334 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.447498 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.447636 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.447776 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.447930 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.448068 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.448230 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.448360 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.448531 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.448657 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.448829 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.448955 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.449134 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.449262 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.449433 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.449559 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.449734 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.449860 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.450030 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.450174 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.450358 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.450496 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.450669 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.450803 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.450973 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.451103 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.451279 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.451407 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.451582 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.451731 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.451933 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.452062 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.452187 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.452310 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.452479 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.452627 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.452781 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.452909 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.453079 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.453215 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.453378 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.453516 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.453678 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.453804 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.453979 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.454107 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.454302 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.454442 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.454604 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.454731 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.454897 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.455023 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.455201 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.455331 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.455499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.455633 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.455793 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.455936 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.456090 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.456227 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.456391 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.456517 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.456689 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.456825 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.456986 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.457115 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.457291 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.457428 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.457605 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.457732 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.457901 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.458037 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.458220 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.458350 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.458536 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.458678 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.458835 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.458967 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.459156 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.459286 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.459440 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.459580 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.459735 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.459870 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.460061 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.460186 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.460393 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.460524 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.460685 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.460813 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.460987 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.461114 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.461299 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.461439 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.461594 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.461728 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.461977 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.462113 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.462300 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.462426 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.462548 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.462673 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.462796 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.462918 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.463103 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.463243 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.463402 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.463537 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.463702 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.463828 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.464002 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.464131 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.464301 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.464428 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.464599 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.464725 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.464934 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.465059 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.465182 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.465312 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.465477 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.465620 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.465775 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.465902 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.466069 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.466215 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.466394 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.466534 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.466695 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.466823 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.466994 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.467269 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.467397 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.467593 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.467804 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.467933 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.468154 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.468283 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.468480 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.468622 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.468791 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.468933 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.469105 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.469233 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.469432 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.469567 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.469738 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.469916 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.470048 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.470193 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.470331 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.470457 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.470636 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.470773 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.470935 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.471065 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.471237 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.471373 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.471536 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.471708 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.471835 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.471958 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.472170 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.472300 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.472438 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.472564 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.472702 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.472839 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.472965 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.473088 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.473244 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.473374 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.473798 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.473930 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.474104 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.474303 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.474442 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.474566 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.474712 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.474855 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.475008 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.475136 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.475305 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.475432 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.475610 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.475735 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.476434 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.476572 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.476732 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.476866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.477028 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.477156 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.477329 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.477465 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.477627 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.477755 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.477924 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.478128 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.478282 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.478422 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.478571 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.478700 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.478900 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.479027 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.479197 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.479335 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.479512 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.479640 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.479808 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.479944 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.480107 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.480236 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.480401 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.480531 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.480700 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.480828 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.480996 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.481124 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.481288 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.481421 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.481585 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.481719 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.481882 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.482011 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.482201 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.482319 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.482507 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.482607 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.482801 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.482900 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.483100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.483207 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.483393 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.483497 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.483687 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.483782 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.483984 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.484078 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.484279 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.484381 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.484569 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.484663 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.484869 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.484964 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.485161 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.485265 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.485453 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.485547 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.485812 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.485918 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.486044 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.486247 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.486377 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.486499 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.486650 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.486789 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.486946 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.487083 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.487241 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.487369 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.487535 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.487663 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.487832 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.487969 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.488129 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.488256 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.488428 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.488565 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.488765 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.488892 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.489027 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.489152 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.489296 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.489422 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.489596 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.489724 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.489890 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.490018 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.490204 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.490348 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.490506 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.490634 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.490803 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.490938 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.491107 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.491245 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.491398 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.491556 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.492256 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.492464 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.492593 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.492727 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.492859 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.492983 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.493108 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.493238 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.493400 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.493539 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.493694 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.493831 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.493987 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.494116 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.494307 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.494441 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.494602 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.494731 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.494933 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.495060 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.495230 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.495368 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.495527 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.495663 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.495825 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.495953 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.496141 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.496271 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.496441 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.496576 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.496724 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.496853 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.497023 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.497152 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.497319 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.497447 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.497653 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.497790 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.497950 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.498078 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.498311 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.498440 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.498614 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.498751 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.498915 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.499041 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.499220 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.499349 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.499520 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.499658 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.499821 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.499955 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.500121 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.500247 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.500415 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.500554 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.500711 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.500830 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.501008 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.501143 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.501315 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.501442 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.501611 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.501739 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.501906 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.502042 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.502230 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.502365 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.502535 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.502660 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.502840 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.502939 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.503137 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.503232 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.503439 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.503534 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.503741 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.503837 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.504036 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.504131 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.504337 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.504431 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.504636 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.504730 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.504936 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.505033 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.505236 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.505338 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.505534 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.505636 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.505835 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.505929 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.506139 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.506256 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.506463 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.506561 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.506851 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.507066 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.507195 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.507385 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.507480 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.507685 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.507779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.507990 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.508133 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.508267 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.508401 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.508573 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.508703 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.508871 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.508999 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.509166 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.509293 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.509461 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.509599 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.509755 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.509891 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.510059 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.510233 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.510387 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.510515 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.510776 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.510915 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.511080 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.511209 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.511383 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.511512 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.511680 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.511807 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.511983 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.512113 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.512278 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.512414 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.512584 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.512802 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.512931 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.513056 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.513186 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.513310 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.513563 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.513700 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.513863 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.514000 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.514181 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.514289 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.514490 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.514600 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.514790 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.514895 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.515090 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.515186 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.515386 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.515489 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.515685 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.515793 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.515988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.516102 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.516285 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.516388 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.516582 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.516679 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.516899 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.516995 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.517200 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.517340 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.517516 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.517645 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.517932 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.518061 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.518283 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.518414 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.518588 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.518716 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.518906 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.519041 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.519226 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.519366 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.519536 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.519665 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.519836 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.519965 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.520150 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.520279 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.520457 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.520596 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.520780 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.520911 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.521101 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.521226 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.521407 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.521536 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.521715 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.521842 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.522017 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.522199 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.522358 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.522498 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.522670 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.522814 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.523062 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.523203 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.523328 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.523453 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.523627 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.523757 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.523937 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.524075 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.524258 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.524399 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.524636 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.524763 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.524956 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.525085 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.525255 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.525376 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.525556 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.525685 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.525862 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.526040 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.526200 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.526319 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.526455 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.526588 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.526802 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.526940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.527072 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.527204 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.527360 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.527573 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.527710 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.527833 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.527976 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.528102 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.528233 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.528368 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.528523 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.528661 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.528835 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.528970 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.529127 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.529264 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.529423 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.529551 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.529740 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.529870 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.530038 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.530217 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.530381 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.530509 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.530683 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.530813 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.531001 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.531140 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.531305 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.531426 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.531604 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.531733 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.531901 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.532029 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.532200 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.532328 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.532496 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.532623 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.532796 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.532927 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.533100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.533215 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.533435 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.533532 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.533733 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.533830 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.534049 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.534185 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.534400 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.534510 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.534720 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.534807 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.535026 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.535114 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.535326 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.535439 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.535636 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.535734 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.535953 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.536040 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.536251 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.536354 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.536549 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.536636 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.536853 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.536937 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.537150 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.537245 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.537447 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.537533 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.537745 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.537832 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.538041 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.538128 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.538902 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.538998 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.539205 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.539291 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.539500 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.539588 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.539794 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.539881 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.540091 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.540178 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.540389 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.540478 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.540696 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.540783 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.541031 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.541132 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.541294 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.541384 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.541606 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.541714 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.541889 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.541985 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.542235 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.542408 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.542552 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.542704 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.542845 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.543006 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.543147 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.543409 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.543566 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.543707 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.543846 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.544002 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.544143 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.544292 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.544431 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.544583 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.544722 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.544870 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.545010 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.545149 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.545287 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.545425 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.545609 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.545756 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.545904 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.546104 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.546274 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.546414 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.546584 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.546725 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.546863 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.547027 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.547170 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.547318 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.547466 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.547609 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.547854 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.548010 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.548179 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.548325 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.548474 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.548626 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.548765 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.548903 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.549066 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.549222 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.549362 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.549499 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.549667 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.549811 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.549970 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.550129 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.550338 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.550513 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.550652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.550791 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.550930 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.551078 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.551217 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.551354 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.551492 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.551659 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.551810 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.551958 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.552121 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.552280 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.552426 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.552575 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.552729 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.552870 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.553013 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.553153 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.553313 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.553589 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.553736 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.553883 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.554657 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.554819 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.554819 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.555095 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.555235 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.555383 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.555522 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.555659 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.555797 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.555949 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.556096 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.556235 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.556381 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.556539 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.556761 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.556911 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.557053 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.557192 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.557192 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.557454 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.557602 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.557742 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.557880 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.558018 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.558177 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.558334 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.558489 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.558637 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.558777 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.558915 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.559053 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.559201 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.559340 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.559553 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.559700 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.559839 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.559976 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.560176 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.560391 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.560543 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.560699 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.560838 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.561014 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.561169 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.561335 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.561481 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.561659 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.561805 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.561952 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.562091 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.562270 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.562409 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.562574 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.562721 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.562871 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.563027 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.563167 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.563314 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.563462 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.563689 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.563850 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.563991 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.564146 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.564296 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.564436 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.564583 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.564732 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.564872 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.565011 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.565148 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.565300 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.565450 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.565589 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.565728 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.565999 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.566218 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.566377 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.566536 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.566677 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.566816 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.566954 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.567108 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.567248 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.567400 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.567548 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.567689 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.567836 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.567976 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.568131 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.568282 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.568422 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.568561 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.568707 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.568846 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.568993 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.569133 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.569278 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.569417 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.569554 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.569723 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.569906 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.570070 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.570241 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.570391 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.570532 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.570678 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.570833 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.570973 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.571119 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.571271 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.571410 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.571548 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.571699 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.571880 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.572029 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.572174 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.572313 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.572467 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.572607 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.572743 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.572882 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.573020 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.573167 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.573315 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.573455 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.573602 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.573828 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.573988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.574136 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.574333 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.574474 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.574626 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.574765 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.574903 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.574903 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.575187 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.575327 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.575472 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.575617 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.575762 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.575921 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.576062 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.576201 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.576338 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.576475 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.576613 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.576760 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.576905 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.577045 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.577183 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.577329 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.577468 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.577624 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.577763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.577900 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.578039 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.578200 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.578345 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.578500 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.578640 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.578786 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.578956 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.579105 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.579289 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.579443 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.579593 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.579815 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.579961 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.580144 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.580299 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.580447 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.580585 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.580773 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.580923 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.581094 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.581254 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.581394 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.581533 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.581682 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.581830 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.581970 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.582118 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.582301 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.582450 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.582599 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.582746 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.582894 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.583077 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.583220 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.583359 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.583508 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.583647 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.583817 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.584028 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.584180 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.584328 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.584475 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.584614 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.584827 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.584968 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.585114 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.585276 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.585429 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.585593 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.585734 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.585873 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.586011 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.586173 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.586334 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.599125 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.599243 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.599321 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.599403 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.599486 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.599567 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.599663 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.599746 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.599834 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.599924 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.600005 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.600092 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.600173 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.600252 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.600337 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.600422 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.600501 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.600592 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.600674 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.600753 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.600828 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.601399 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.601480 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.601569 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.601649 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.601729 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.601729 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.601872 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.601959 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.602039 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.602039 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.602201 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.602378 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.602468 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.602564 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.602645 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.602731 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.602811 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.602899 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.602981 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603068 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603149 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603228 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603306 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603384 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603471 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603551 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603629 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603707 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603785 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603863 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.603959 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604041 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604120 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604194 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604261 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604339 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604429 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604509 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604594 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604673 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604751 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604829 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.604915 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605013 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605094 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605175 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605261 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605348 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605428 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605509 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605587 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605664 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605749 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605836 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605916 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.605994 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.606072 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.606170 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.606281 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.606370 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.606453 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.606453 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.606596 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.606681 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.606761 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.606847 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.606939 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607019 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607105 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607190 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607277 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607357 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607435 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607529 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607608 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607686 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607772 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607859 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.607938 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608016 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608100 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608179 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608265 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608345 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608429 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608509 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608586 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608759 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608839 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608917 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.608994 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.609072 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.609158 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.609237 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.609322 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.609402 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.609525 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.609615 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.609708 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.609788 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.609873 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.609953 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610031 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610108 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610228 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610312 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610390 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610472 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610550 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610641 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610729 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610809 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610887 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.610965 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611043 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611135 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611223 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611302 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611387 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611474 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611554 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611641 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611720 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611798 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611876 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.611961 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612041 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612131 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612218 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612298 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612480 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612568 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612648 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612726 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612804 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612882 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.612959 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613046 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613127 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613205 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613282 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613360 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613437 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613523 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613610 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613690 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613768 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613836 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.613989 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614060 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614134 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614232 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614307 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614373 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614452 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614533 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614618 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614699 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614784 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614864 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.614950 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.615031 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.615106 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.615173 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.615238 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.615323 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.615410 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.615583 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.615759 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.615904 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.616065 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.616244 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.616403 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.617107 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.617271 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.617451 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.617581 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.617776 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.617873 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.618085 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.618229 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.618420 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.618522 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 08:37:50.618723 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:37:50.618963 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 08:37:50.772495 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO dbcounter [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Registered counter for database nova_api Sep 11 08:37:50.773132 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO dbcounter [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Registered counter for database nova_api Sep 11 08:37:50.794047 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_db.sqlalchemy.engines [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:37:50.795632 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG oslo_db.sqlalchemy.engines [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:37:50.800700 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writer thread running {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:37:50.802311 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writer thread running {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:37:50.858298 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.context [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),382ca797-322f-42ed-b065-8d7753b9f2b1(cell1) {{(pid=112603) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 08:37:50.860533 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.context [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),382ca797-322f-42ed-b065-8d7753b9f2b1(cell1) {{(pid=112604) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 08:37:50.862192 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:37:50.862661 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:37:50.864199 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:37:50.864395 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG oslo_concurrency.lockutils [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:37:50.864868 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG oslo_concurrency.lockutils [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:37:50.864969 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:37:50.865347 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:37:50.866462 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG oslo_concurrency.lockutils [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:37:50.867195 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG oslo_concurrency.lockutils [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:37:50.867387 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:37:50.867638 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG oslo_concurrency.lockutils [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:37:50.869390 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO dbcounter [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Registered counter for database nova_cell0 Sep 11 08:37:50.869648 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG oslo_concurrency.lockutils [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:37:50.871692 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO dbcounter [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Registered counter for database nova_cell0 Sep 11 08:37:50.873497 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO dbcounter [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Registered counter for database nova_cell1 Sep 11 08:37:50.875952 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO dbcounter [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Registered counter for database nova_cell1 Sep 11 08:37:50.882717 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_db.sqlalchemy.engines [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:37:50.883916 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_db.sqlalchemy.engines [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:37:50.884987 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG oslo_db.sqlalchemy.engines [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:37:50.885947 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG oslo_db.sqlalchemy.engines [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:37:50.890559 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writer thread running {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:37:50.892005 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writer thread running {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:37:50.893214 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writer thread running {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:37:50.894719 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writer thread running {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:37:51.035688 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO dbcounter [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Registered counter for database nova_cell0 Sep 11 08:37:51.042446 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO dbcounter [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Registered counter for database nova_cell0 Sep 11 08:37:51.045554 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_db.sqlalchemy.engines [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:37:51.050084 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writer thread running {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:37:51.051311 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG oslo_db.sqlalchemy.engines [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:37:51.056143 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writer thread running {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:37:51.445689 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: WARNING keystonemiddleware.auth_token [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 08:37:51.453027 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: WARNING keystonemiddleware.auth_token [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 08:37:51.472517 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: WARNING keystonemiddleware.auth_token [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 08:37:51.480618 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: WARNING keystonemiddleware.auth_token [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 08:37:51.795094 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: WARNING keystonemiddleware.auth_token [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 08:37:51.800983 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: WARNING keystonemiddleware.auth_token [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 08:37:51.806474 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56382cfd39c0 pid: 112603 (default app) Sep 11 08:37:51.808516 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:37:51.809695 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001703 Sep 11 08:37:51.810101 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Sun Sep 11 08:37:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:37:51.831373 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: WARNING keystonemiddleware.auth_token [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 08:37:51.837936 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: WARNING keystonemiddleware.auth_token [None req-d2208362-780f-4eee-a0c2-ffa19ab6ccd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 08:37:51.843266 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56382cfd39c0 pid: 112604 (default app) Sep 11 08:39:22.156359 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:22.158026 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Sep 11 08:39:22.158467 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:39:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:39:22.171361 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writing DB stats nova_api:SELECT=3 {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:22.172327 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writing DB stats nova_cell0:SELECT=3 {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:22.173377 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writing DB stats nova_cell1:SELECT=3 {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:22.174540 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:23.427569 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-c76a8a41-23cd-4f85-8fca-4d40aa835e59 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:23.484535 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-c76a8a41-23cd-4f85-8fca-4d40aa835e59 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.318111 Sep 11 08:39:23.485971 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1292 bytes} [Sun Sep 11 08:39:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:39:26.400923 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:26.401950 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-a30eca06-b762-4f6e-8e75-b455510dc2e6 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 11 08:39:26.402620 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:39:27.007876 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-dd2d9ba8-d075-422d-bdd5-81586a856a05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0}} {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:27.135612 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-dd2d9ba8-d075-422d-bdd5-81586a856a05 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.726154 Sep 11 08:39:27.136190 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 08:39:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:39:27.152416 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writing DB stats nova_api:SELECT=3 {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:27.153847 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writing DB stats nova_cell0:SELECT=3 {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:27.155912 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writing DB stats nova_cell1:SELECT=3 {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:27.156778 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:27.383619 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-96840157-c275-41fa-81b9-564cdb3c5c73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:27.544625 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-96840157-c275-41fa-81b9-564cdb3c5c73 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.398936 Sep 11 08:39:27.545626 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1336 bytes} [Sun Sep 11 08:39:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:39:30.363241 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-dd2d9ba8-d075-422d-bdd5-81586a856a05 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:30.365152 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-dd2d9ba8-d075-422d-bdd5-81586a856a05 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Sep 11 08:39:30.366136 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:39:31.110366 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-f3e6cc7e-2265-4454-8acf-f9beba26822e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "id": "d1"}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:31.275106 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-f3e6cc7e-2265-4454-8acf-f9beba26822e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.899875 Sep 11 08:39:31.277151 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 08:39:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:39:31.291943 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-d99d8099-1bcb-4080-a3bf-8e87b3ef7ad0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:31.419392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-d99d8099-1bcb-4080-a3bf-8e87b3ef7ad0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132109 Sep 11 08:39:31.422409 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1336 bytes} [Sun Sep 11 08:39:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:39:34.715368 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-f3e6cc7e-2265-4454-8acf-f9beba26822e admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:34.719065 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-f3e6cc7e-2265-4454-8acf-f9beba26822e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002381 Sep 11 08:39:34.719065 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:39:35.281016 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-6ee2a635-70ab-46cc-992c-aaaec7cc1f0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1}} {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:35.345784 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-6ee2a635-70ab-46cc-992c-aaaec7cc1f0d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.617735 Sep 11 08:39:35.346280 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 08:39:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:39:35.359404 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-540f6d82-eed8-436f-afd4-8d7ed240643c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:35.448246 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-540f6d82-eed8-436f-afd4-8d7ed240643c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092262 Sep 11 08:39:35.458232 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1336 bytes} [Sun Sep 11 08:39:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:39:38.346440 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-6ee2a635-70ab-46cc-992c-aaaec7cc1f0d admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:38.349665 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-6ee2a635-70ab-46cc-992c-aaaec7cc1f0d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003622 Sep 11 08:39:38.351027 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:39:38 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:39:38.964109 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-a3863783-6c46-41e8-bf03-38ecf0404d12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "swap": 0, "disk": 10}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:39.038373 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-a3863783-6c46-41e8-bf03-38ecf0404d12 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.678703 Sep 11 08:39:39.039201 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 08:39:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:39:39.053244 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-dd9f3559-9639-4591-9ac0-d826c07314fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:39.140064 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-dd9f3559-9639-4591-9ac0-d826c07314fc admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091470 Sep 11 08:39:39.140696 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1336 bytes} [Sun Sep 11 08:39:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:39:42.051879 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-a3863783-6c46-41e8-bf03-38ecf0404d12 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:42.052894 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-a3863783-6c46-41e8-bf03-38ecf0404d12 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 11 08:39:42.053296 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:39:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:39:42.533176 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-5ec676b0-4747-4b49-b1a1-de4e536f2f70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "ram": 4096, "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20}} {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:42.591970 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-5ec676b0-4747-4b49-b1a1-de4e536f2f70 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.532225 Sep 11 08:39:42.592520 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 08:39:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:39:42.606690 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-bb4dedee-4c6a-48a5-b351-4a39d37e0d3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:42.699537 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-bb4dedee-4c6a-48a5-b351-4a39d37e0d3b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097880 Sep 11 08:39:42.700085 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1336 bytes} [Sun Sep 11 08:39:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:39:45.400187 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-5ec676b0-4747-4b49-b1a1-de4e536f2f70 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:45.401224 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-5ec676b0-4747-4b49-b1a1-de4e536f2f70 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 11 08:39:45.401633 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:39:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:39:45.934476 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-79bbd4b9-c786-4d90-a902-c15024eb7375 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:45.976345 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-79bbd4b9-c786-4d90-a902-c15024eb7375 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.567087 Sep 11 08:39:45.977096 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1292 bytes} [Sun Sep 11 08:39:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:39:48.861472 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-5ec676b0-4747-4b49-b1a1-de4e536f2f70 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:48.862448 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-5ec676b0-4747-4b49-b1a1-de4e536f2f70 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 11 08:39:48.863400 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:39:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:39:49.392771 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-8dd06d34-ed90-49fb-8c9f-1ea67ebed355 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "swap": 0}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:49.671685 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-8dd06d34-ed90-49fb-8c9f-1ea67ebed355 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.801292 Sep 11 08:39:49.672552 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 08:39:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:39:49.689407 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-8bae835f-5cbd-4f4b-aa0e-0fdd64cf0575 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:49.854399 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-8bae835f-5cbd-4f4b-aa0e-0fdd64cf0575 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.171129 Sep 11 08:39:49.858234 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1333 bytes} [Sun Sep 11 08:39:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:39:52.653696 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-8dd06d34-ed90-49fb-8c9f-1ea67ebed355 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:52.654684 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-8dd06d34-ed90-49fb-8c9f-1ea67ebed355 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Sep 11 08:39:52.655099 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:39:53.154561 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-71e7ca45-bc4c-4376-9ccc-a2748f6bb8e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:53.161670 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:39:53.303692 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-71e7ca45-bc4c-4376-9ccc-a2748f6bb8e0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.640914 Sep 11 08:39:53.305029 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 08:39:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:39:53.317412 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-e8c892cf-cc5f-4bb6-8126-dae65694aa4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:53.418995 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-e8c892cf-cc5f-4bb6-8126-dae65694aa4a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105440 Sep 11 08:39:53.419925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1333 bytes} [Sun Sep 11 08:39:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:39:56.443093 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-71e7ca45-bc4c-4376-9ccc-a2748f6bb8e0 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:39:56.445978 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-71e7ca45-bc4c-4376-9ccc-a2748f6bb8e0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003663 Sep 11 08:39:56.456181 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:39:56.972737 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-39dfd0b2-4a24-43b0-828d-c7443979bff7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "disk": 40, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:57.062114 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-39dfd0b2-4a24-43b0-828d-c7443979bff7 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.598855 Sep 11 08:39:57.063465 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 08:39:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:39:57.082327 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-55acf335-2259-4188-88bf-c8655572f946 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:39:57.175221 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-55acf335-2259-4188-88bf-c8655572f946 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100657 Sep 11 08:39:57.176311 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1333 bytes} [Sun Sep 11 08:39:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:40:00.100071 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-39dfd0b2-4a24-43b0-828d-c7443979bff7 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:00.101378 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-39dfd0b2-4a24-43b0-828d-c7443979bff7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001762 Sep 11 08:40:00.101806 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:40:00.651583 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-a3afa9d2-f322-4102-9039-56cf5010506f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "vcpus": 4, "name": "m1.large"}} {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:40:00.846281 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-a3afa9d2-f322-4102-9039-56cf5010506f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.736951 Sep 11 08:40:00.847180 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 08:40:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:40:00.864350 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-c245268f-d9e9-4aba-9ce4-e1507496f56f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:40:00.876980 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:01.070397 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-c245268f-d9e9-4aba-9ce4-e1507496f56f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.214673 Sep 11 08:40:01.071700 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1333 bytes} [Sun Sep 11 08:40:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:40:03.868389 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-a3afa9d2-f322-4102-9039-56cf5010506f admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:03.869412 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-a3afa9d2-f322-4102-9039-56cf5010506f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 11 08:40:03.870058 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:40:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:40:04.372245 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-49886a18-6aab-433a-a807-4692ec6e3eb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "ram": 16384, "vcpus": 8}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:40:04.449573 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-49886a18-6aab-433a-a807-4692ec6e3eb6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.572841 Sep 11 08:40:04.449980 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1283 bytes} [Sun Sep 11 08:40:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:40:04.462475 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-3cb986cb-4903-4d43-8fea-63533ca24c89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:40:04.545049 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-3cb986cb-4903-4d43-8fea-63533ca24c89 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086605 Sep 11 08:40:04.545736 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1333 bytes} [Sun Sep 11 08:40:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:40:20.896798 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-49886a18-6aab-433a-a807-4692ec6e3eb6 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:20.897815 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-49886a18-6aab-433a-a807-4692ec6e3eb6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 11 08:40:20.898241 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:40:20.909258 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:21.308978 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-3e87e851-753b-4f54-8bc4-c610ddbf5119 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:21.328826 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-3e87e851-753b-4f54-8bc4-c610ddbf5119 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.424513 Sep 11 08:40:21.329392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1292 bytes} [Sun Sep 11 08:40:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:40:22.681559 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-49886a18-6aab-433a-a807-4692ec6e3eb6 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:22.682603 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-49886a18-6aab-433a-a807-4692ec6e3eb6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 11 08:40:22.682999 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:40:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:40:23.215400 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-d57c7188-d2f3-4052-9896-7f81883a6f7f admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:23.221028 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.wsgi [None req-d57c7188-d2f3-4052-9896-7f81883a6f7f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-d57c7188-d2f3-4052-9896-7f81883a6f7f admin admin] Request method failure captured: Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Accept: application/json Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Accept-Encoding: gzip, deflate Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Connection: keep-alive Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Content-Length: 0 Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Host: 10.222.0.44 Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Openstack-Api-Version: compute 2.92 Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Openstack-System-Scope: None Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: User-Agent: python-novaclient Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Auth-Token: gAAAAABjHZ72LPyhiKkvT6vg9zeqlzF-Ku9hdyWgGdfCBFafMOo1WVgze6_hO2IG28rXg3y7tUZLn-Ldn5qPf3QayZIw8RAd1jd_y-yj5rEQT0sgy2ettA-LLPvQUG8d2_4FJdjOPdfqA8n1-N6Rs61hVx6KhFVgie4pHKol3hhjP--J5hSTGzY Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Domain-Id: None Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Domain-Name: None Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Identity-Status: Confirmed Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Is-Admin-Project: True Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Domain-Id: default Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Domain-Name: Default Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Name: admin Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Role: admin,reader,member Sep 11 08:40:23.224392 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Roles: admin,reader,member Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_878028e7aaff4c28815b9cd862f1c36e", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Tenant: admin Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Tenant-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Tenant-Name: admin Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User: admin Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Domain-Id: default Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Domain-Name: Default Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Id: e0cb001df8d24a87b7f9253f68745c35 Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Name: admin Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: method: > Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: exception: Flavor 42 could not be found. Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: action_args: {'id': '42'} Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:40:23.226381 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:23.227499 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:23.228866 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-d57c7188-d2f3-4052-9896-7f81883a6f7f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:40:23.230494 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-d57c7188-d2f3-4052-9896-7f81883a6f7f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.404412 Sep 11 08:40:23.230494 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Sun Sep 11 08:40:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:23.235932 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-2fb20a21-d10a-4d17-8082-988990424641 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:23.240505 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:40:23.259538 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-2fb20a21-d10a-4d17-8082-988990424641 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027135 Sep 11 08:40:23.260098 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 08:40:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:40:23.270900 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-dbd73326-5238-4b77-9f4c-c87eed34f4c6 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:23.292880 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-dbd73326-5238-4b77-9f4c-c87eed34f4c6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026574 Sep 11 08:40:23.293446 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 08:40:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:40:23.303518 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-171b7929-8e38-4941-8360-9f77ef232329 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:23.309406 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.wsgi [None req-171b7929-8e38-4941-8360-9f77ef232329 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-171b7929-8e38-4941-8360-9f77ef232329 admin admin] Request method failure captured: Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Accept: application/json Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Accept-Encoding: gzip, deflate Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Connection: keep-alive Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Content-Length: 0 Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Host: 10.222.0.44 Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Openstack-Api-Version: compute 2.92 Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Openstack-System-Scope: None Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: User-Agent: python-novaclient Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Auth-Token: gAAAAABjHZ72LPyhiKkvT6vg9zeqlzF-Ku9hdyWgGdfCBFafMOo1WVgze6_hO2IG28rXg3y7tUZLn-Ldn5qPf3QayZIw8RAd1jd_y-yj5rEQT0sgy2ettA-LLPvQUG8d2_4FJdjOPdfqA8n1-N6Rs61hVx6KhFVgie4pHKol3hhjP--J5hSTGzY Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Domain-Id: None Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Domain-Name: None Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Identity-Status: Confirmed Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Is-Admin-Project: True Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Domain-Id: default Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Domain-Name: Default Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Name: admin Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Role: admin,reader,member Sep 11 08:40:23.312886 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Roles: admin,reader,member Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_878028e7aaff4c28815b9cd862f1c36e", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Tenant: admin Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Tenant-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Tenant-Name: admin Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User: admin Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Domain-Id: default Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Domain-Name: Default Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Id: e0cb001df8d24a87b7f9253f68745c35 Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Name: admin Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: method: > Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: exception: Flavor 42 could not be found. Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: action_args: {'id': '42'} Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:40:23.314224 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:23.315693 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:23.316779 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-171b7929-8e38-4941-8360-9f77ef232329 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:40:23.317752 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-171b7929-8e38-4941-8360-9f77ef232329 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014446 Sep 11 08:40:23.317752 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Sun Sep 11 08:40:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:24.590888 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-dbd73326-5238-4b77-9f4c-c87eed34f4c6 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:24.591924 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-dbd73326-5238-4b77-9f4c-c87eed34f4c6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 11 08:40:24.592350 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:40:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:40:25.139607 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-d8d3c2e2-8889-464e-bcb1-27db931d798b admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:25.144708 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.wsgi [None req-d8d3c2e2-8889-464e-bcb1-27db931d798b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-d8d3c2e2-8889-464e-bcb1-27db931d798b admin admin] Request method failure captured: Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Accept: application/json Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Accept-Encoding: gzip, deflate Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Connection: keep-alive Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Content-Length: 0 Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Host: 10.222.0.44 Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Openstack-Api-Version: compute 2.92 Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Openstack-System-Scope: None Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: User-Agent: python-novaclient Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Auth-Token: gAAAAABjHZ743fXb9mpZr_eZU9XztyE61B8CTmx_rwVwrTWAcUy0ljOo3QKfc6LN5Fo0ab9MHkXjKlPT4wbu9tw2GPLP1kBQAxWqr5W9mLC3vsL13-yMkRq5iV-o5rgnpAaN6iZrLRqZoH8lLS2HIBVgOJ7AhrtOQ-2f-3XvaBhRmrCGr3NLfAY Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Domain-Id: None Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Domain-Name: None Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Identity-Status: Confirmed Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Is-Admin-Project: True Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Domain-Id: default Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Domain-Name: Default Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Name: admin Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Role: admin,reader,member Sep 11 08:40:25.146234 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Roles: admin,reader,member Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_878028e7aaff4c28815b9cd862f1c36e", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Tenant: admin Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Tenant-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Tenant-Name: admin Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User: admin Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Domain-Id: default Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Domain-Name: Default Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Id: e0cb001df8d24a87b7f9253f68745c35 Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Name: admin Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: method: > Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: exception: Flavor 84 could not be found. Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: action_args: {'id': '84'} Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:40:25.147763 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:25.148635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:25.149692 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-d8d3c2e2-8889-464e-bcb1-27db931d798b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:40:25.150767 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-d8d3c2e2-8889-464e-bcb1-27db931d798b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.417206 Sep 11 08:40:25.150767 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Sun Sep 11 08:40:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:25.159003 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-648e750a-ca72-43cb-a3d3-8665666fd454 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:25.173354 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-648e750a-ca72-43cb-a3d3-8665666fd454 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019405 Sep 11 08:40:25.174520 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 08:40:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:40:25.184155 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-b062eb6e-dada-4c9c-b232-bba84dc1f38c admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:25.199500 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-b062eb6e-dada-4c9c-b232-bba84dc1f38c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018892 Sep 11 08:40:25.200016 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 08:40:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:40:25.209328 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-f3cc9f7f-38a4-447b-b715-6d0e56d1f617 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:25.214472 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.wsgi [None req-f3cc9f7f-38a4-447b-b715-6d0e56d1f617 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-f3cc9f7f-38a4-447b-b715-6d0e56d1f617 admin admin] Request method failure captured: Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Accept: application/json Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Accept-Encoding: gzip, deflate Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Connection: keep-alive Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Content-Length: 0 Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Host: 10.222.0.44 Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Openstack-Api-Version: compute 2.92 Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Openstack-System-Scope: None Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: User-Agent: python-novaclient Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Auth-Token: gAAAAABjHZ743fXb9mpZr_eZU9XztyE61B8CTmx_rwVwrTWAcUy0ljOo3QKfc6LN5Fo0ab9MHkXjKlPT4wbu9tw2GPLP1kBQAxWqr5W9mLC3vsL13-yMkRq5iV-o5rgnpAaN6iZrLRqZoH8lLS2HIBVgOJ7AhrtOQ-2f-3XvaBhRmrCGr3NLfAY Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Domain-Id: None Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Domain-Name: None Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Identity-Status: Confirmed Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Is-Admin-Project: True Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Domain-Id: default Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Domain-Name: Default Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Name: admin Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Role: admin,reader,member Sep 11 08:40:25.215988 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Roles: admin,reader,member Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_878028e7aaff4c28815b9cd862f1c36e", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Tenant: admin Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Tenant-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Tenant-Name: admin Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User: admin Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Domain-Id: default Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Domain-Name: Default Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Id: e0cb001df8d24a87b7f9253f68745c35 Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Name: admin Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: method: > Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: exception: Flavor 84 could not be found. Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: action_args: {'id': '84'} Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:40:25.217652 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:25.218940 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:25.220268 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-f3cc9f7f-38a4-447b-b715-6d0e56d1f617 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:40:25.222106 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-f3cc9f7f-38a4-447b-b715-6d0e56d1f617 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011595 Sep 11 08:40:25.222106 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Sun Sep 11 08:40:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:26.472889 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-b062eb6e-dada-4c9c-b232-bba84dc1f38c admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:26.473934 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-b062eb6e-dada-4c9c-b232-bba84dc1f38c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 11 08:40:26.474359 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:40:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:40:27.007608 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-b3ca21a9-15c8-4e72-b46d-799a2997f71c admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:27.013539 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.wsgi [None req-b3ca21a9-15c8-4e72-b46d-799a2997f71c admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-b3ca21a9-15c8-4e72-b46d-799a2997f71c admin admin] Request method failure captured: Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Accept: application/json Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Accept-Encoding: gzip, deflate Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Connection: keep-alive Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Content-Length: 0 Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Host: 10.222.0.44 Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Openstack-Api-Version: compute 2.92 Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Openstack-System-Scope: None Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: User-Agent: python-novaclient Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Auth-Token: gAAAAABjHZ76S8ArN4gAKkEK82Rgzj_5i7Y7wlGrWHFyQKcLSoCEOeTsvvp2gV_aSjZ431W-OipERzxSTuKfiIj0dDDMGcf3MTbs2c7aH5LPJ1SH9bYMlZb2H5pXHtFRLnrtmu8wnCdH-lwuWmmx_XNqa3bgd1qXcxxLitFFhGWWoEInqWxjfqw Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Domain-Id: None Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Domain-Name: None Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Identity-Status: Confirmed Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Is-Admin-Project: True Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Domain-Id: default Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Domain-Name: Default Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Project-Name: admin Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Role: admin,reader,member Sep 11 08:40:27.015210 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Roles: admin,reader,member Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_878028e7aaff4c28815b9cd862f1c36e", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Tenant: admin Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Tenant-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-Tenant-Name: admin Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User: admin Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Domain-Id: default Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Domain-Name: Default Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Id: e0cb001df8d24a87b7f9253f68745c35 Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: X-User-Name: admin Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: method: > Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: exception: Flavor 451 could not be found. Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: action_args: {'id': '451'} Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:40:27.016671 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:27.017456 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: ERROR nova.api.openstack.wsgi Sep 11 08:40:27.019100 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-b3ca21a9-15c8-4e72-b46d-799a2997f71c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:40:27.020110 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-b3ca21a9-15c8-4e72-b46d-799a2997f71c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.405680 Sep 11 08:40:27.020110 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 08:40:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:27.027024 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-f8652287-98f5-4d5d-9a95-ca84dfb12575 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:27.043471 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-f8652287-98f5-4d5d-9a95-ca84dfb12575 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019925 Sep 11 08:40:27.044017 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 08:40:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:40:27.053635 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:27.068642 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018507 Sep 11 08:40:27.069208 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Sun Sep 11 08:40:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:40:27.078915 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-ce97572e-4882-4083-9c29-99105abb9b75 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:27.084594 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.wsgi [None req-ce97572e-4882-4083-9c29-99105abb9b75 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-ce97572e-4882-4083-9c29-99105abb9b75 admin admin] Request method failure captured: Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Accept: application/json Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Accept-Encoding: gzip, deflate Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Connection: keep-alive Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Content-Length: 0 Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Host: 10.222.0.44 Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Openstack-Api-Version: compute 2.92 Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Openstack-System-Scope: None Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: User-Agent: python-novaclient Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Auth-Token: gAAAAABjHZ76S8ArN4gAKkEK82Rgzj_5i7Y7wlGrWHFyQKcLSoCEOeTsvvp2gV_aSjZ431W-OipERzxSTuKfiIj0dDDMGcf3MTbs2c7aH5LPJ1SH9bYMlZb2H5pXHtFRLnrtmu8wnCdH-lwuWmmx_XNqa3bgd1qXcxxLitFFhGWWoEInqWxjfqw Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Domain-Id: None Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Domain-Name: None Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Identity-Status: Confirmed Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Is-Admin-Project: True Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Openstack-Nova-Api-Version: 2.92 Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Domain-Id: default Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Domain-Name: Default Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Project-Name: admin Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Role: admin,reader,member Sep 11 08:40:27.086112 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Roles: admin,reader,member Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/878028e7aaff4c28815b9cd862f1c36e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_878028e7aaff4c28815b9cd862f1c36e", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Tenant: admin Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Tenant-Id: 878028e7aaff4c28815b9cd862f1c36e Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-Tenant-Name: admin Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User: admin Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Domain-Id: default Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Domain-Name: Default Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Id: e0cb001df8d24a87b7f9253f68745c35 Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: X-User-Name: admin Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: method: > Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: exception: Flavor 451 could not be found. Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: action_args: {'id': '451'} Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:40:27.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:27.088635 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: ERROR nova.api.openstack.wsgi Sep 11 08:40:27.089925 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-ce97572e-4882-4083-9c29-99105abb9b75 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:40:27.091056 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-ce97572e-4882-4083-9c29-99105abb9b75 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012313 Sep 11 08:40:27.091056 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 08:40:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 11 08:40:28.333481 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:28.334519 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 11 08:40:28.334910 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:40:28.875136 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-b59aaa0f-b010-4bf5-a3f4-9484110d3443 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:40:28.945717 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-b59aaa0f-b010-4bf5-a3f4-9484110d3443 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.473031 Sep 11 08:40:28.946296 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Sun Sep 11 08:40:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:40:30.179983 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:30.181022 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 11 08:40:30.181411 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:40:30.714065 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-d8299c81-7981-4c3d-a469-eed38f58e521 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:40:30.785642 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-d8299c81-7981-4c3d-a469-eed38f58e521 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.465911 Sep 11 08:40:30.786111 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Sun Sep 11 08:40:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:40:32.035168 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:32.036102 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 11 08:40:32.036586 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:40:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:40:32.568268 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-65074b37-b2f2-4b35-8cb8-d2e1116b3e0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:40:32.630794 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-65074b37-b2f2-4b35-8cb8-d2e1116b3e0d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.457038 Sep 11 08:40:32.631271 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Sun Sep 11 08:40:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:40:33.882335 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:33.883324 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 11 08:40:33.883712 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:40:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:40:34.421132 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-20c212b9-2882-4e83-bc48-a2a2f06d0dae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:40:34.494701 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-20c212b9-2882-4e83-bc48-a2a2f06d0dae admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.471325 Sep 11 08:40:34.495277 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Sun Sep 11 08:40:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:40:35.750320 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:35.751355 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 11 08:40:35.751778 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:40:36.285856 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-a0120fc1-56fa-4e45-94a6-e266d4f341ad admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:40:36.318737 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-a0120fc1-56fa-4e45-94a6-e266d4f341ad admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.419726 Sep 11 08:40:36.318737 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Sun Sep 11 08:40:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:41:34.476744 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:41:34.477938 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-5bb36329-dec2-4a2d-bbbe-94638bbe4e9b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001725 Sep 11 08:41:34.478389 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 931 bytes} [Sun Sep 11 08:41:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:41:34.489505 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:34.887346 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-3f4a73fc-ae73-44b8-a281-f9266768aae7 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:41:34.908381 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-3f4a73fc-ae73-44b8-a281-f9266768aae7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.423855 Sep 11 08:41:34.908924 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1292 bytes} [Sun Sep 11 08:41:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:41:34.930312 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writing DB stats nova_api:SELECT=14 {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:41:34.934088 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-8df7ec28-bef5-495b-8de0-11b020eb5225 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:41:34.941360 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-8df7ec28-bef5-495b-8de0-11b020eb5225 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012519 Sep 11 08:41:34.942637 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1283 bytes} [Sun Sep 11 08:41:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:41:34.954423 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-95f9a8b1-ce3d-4b19-80c9-45d0f35693bf admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:41:34.961729 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-95f9a8b1-ce3d-4b19-80c9-45d0f35693bf admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011256 Sep 11 08:41:34.962279 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1286 bytes} [Sun Sep 11 08:41:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:41:34.974987 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-ff06b998-b7ef-4b81-b175-ad7cbae40a69 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:41:34.983115 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-ff06b998-b7ef-4b81-b175-ad7cbae40a69 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012113 Sep 11 08:41:34.983661 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1286 bytes} [Sun Sep 11 08:41:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:41:34.996195 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-f333be1e-1a8c-4d58-81bb-c6dad658b6f0 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:41:35.003541 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-f333be1e-1a8c-4d58-81bb-c6dad658b6f0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011029 Sep 11 08:41:35.004066 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1283 bytes} [Sun Sep 11 08:41:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:44:41.913566 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-ff06b998-b7ef-4b81-b175-ad7cbae40a69 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:44:41.914616 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-ff06b998-b7ef-4b81-b175-ad7cbae40a69 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 11 08:44:41.915015 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:44:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:44:42.055589 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writing DB stats nova_api:SELECT=6 {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:44:42.214958 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-bcfb04b0-346c-4cdd-b461-042acd81cb25 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:44:42.219674 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-bcfb04b0-346c-4cdd-b461-042acd81cb25 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:44:42.220145 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-bcfb04b0-346c-4cdd-b461-042acd81cb25 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:44:42.220568 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-bcfb04b0-346c-4cdd-b461-042acd81cb25 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:44:42.221266 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-bcfb04b0-346c-4cdd-b461-042acd81cb25 admin admin] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:44:42.221706 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-bcfb04b0-346c-4cdd-b461-042acd81cb25 admin admin] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:44:42.222115 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-bcfb04b0-346c-4cdd-b461-042acd81cb25 admin admin] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:44:42.254401 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-bcfb04b0-346c-4cdd-b461-042acd81cb25 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.200021 Sep 11 08:44:42.254951 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 08:44:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:44:43.342970 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-ff06b998-b7ef-4b81-b175-ad7cbae40a69 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:44:43.344040 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-ff06b998-b7ef-4b81-b175-ad7cbae40a69 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002018 Sep 11 08:44:43.344477 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:44:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:44:43.538739 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-b331a2f6-9371-4fca-9c37-a29a2ccfb7a1 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:44:43.542410 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-b331a2f6-9371-4fca-9c37-a29a2ccfb7a1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:44:43.542896 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-b331a2f6-9371-4fca-9c37-a29a2ccfb7a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:44:43.543581 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-b331a2f6-9371-4fca-9c37-a29a2ccfb7a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:44:43.546050 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-b331a2f6-9371-4fca-9c37-a29a2ccfb7a1 admin admin] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:44:43.546050 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-b331a2f6-9371-4fca-9c37-a29a2ccfb7a1 admin admin] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:44:43.546050 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-b331a2f6-9371-4fca-9c37-a29a2ccfb7a1 admin admin] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:44:43.565416 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-b331a2f6-9371-4fca-9c37-a29a2ccfb7a1 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.080592 Sep 11 08:44:43.565922 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 08:44:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:44:55.064316 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-ff06b998-b7ef-4b81-b175-ad7cbae40a69 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:44:55.065318 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-ff06b998-b7ef-4b81-b175-ad7cbae40a69 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 11 08:44:55.065739 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:44:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:44:55.209859 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writing DB stats nova_cell0:SELECT=4 {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:44:55.210559 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writing DB stats nova_cell1:SELECT=4 {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:44:55.211174 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG dbcounter [-] [112603] Writing DB stats nova_api:SELECT=8 {{(pid=112603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:44:55.259805 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-570f4c1e-ba35-4af5-8d87-30605aa8a980 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:44:55.263253 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-570f4c1e-ba35-4af5-8d87-30605aa8a980 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:44:55.263725 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-570f4c1e-ba35-4af5-8d87-30605aa8a980 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:44:55.264687 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-570f4c1e-ba35-4af5-8d87-30605aa8a980 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:44:55.265393 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-570f4c1e-ba35-4af5-8d87-30605aa8a980 admin admin] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:44:55.265831 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-570f4c1e-ba35-4af5-8d87-30605aa8a980 admin admin] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:44:55.266266 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-570f4c1e-ba35-4af5-8d87-30605aa8a980 admin admin] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:44:55.291932 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-570f4c1e-ba35-4af5-8d87-30605aa8a980 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086699 Sep 11 08:44:55.292481 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 08:44:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:44:56.374826 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG nova.api.openstack.wsgi [None req-ff06b998-b7ef-4b81-b175-ad7cbae40a69 admin admin] Calling method '>' {{(pid=112604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:44:56.375829 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: INFO nova.api.openstack.requestlog [None req-ff06b998-b7ef-4b81-b175-ad7cbae40a69 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 11 08:44:56.376218 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: [pid: 112604|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Sun Sep 11 08:44:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:44:56.567614 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG nova.api.openstack.wsgi [None req-94961c21-ed4e-472f-ac24-cf960ce89db4 admin admin] Calling method '>' {{(pid=112603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:44:56.570498 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-94961c21-ed4e-472f-ac24-cf960ce89db4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:44:56.570975 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-94961c21-ed4e-472f-ac24-cf960ce89db4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:44:56.571402 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-94961c21-ed4e-472f-ac24-cf960ce89db4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:44:56.572168 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-94961c21-ed4e-472f-ac24-cf960ce89db4 admin admin] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:44:56.572616 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-94961c21-ed4e-472f-ac24-cf960ce89db4 admin admin] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:44:56.573032 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: DEBUG oslo_concurrency.lockutils [None req-94961c21-ed4e-472f-ac24-cf960ce89db4 admin admin] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:44:56.595754 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: INFO nova.api.openstack.requestlog [None req-94961c21-ed4e-472f-ac24-cf960ce89db4 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079783 Sep 11 08:44:56.596236 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: [pid: 112603|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Sun Sep 11 08:44:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:45:51.604396 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: Sun Sep 11 08:45:51 2022 - graceful shutdown triggered... Sep 11 08:45:51.604147 dv-cinder-856941-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 11 08:45:51.605570 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: Gracefully killing worker 2 (pid: 112604)... Sep 11 08:45:51.605952 dv-cinder-856941-2-iscsi devstack@n-api.service[112603]: Gracefully killing worker 1 (pid: 112603)... Sep 11 08:45:51.734955 dv-cinder-856941-2-iscsi devstack@n-api.service[112604]: DEBUG dbcounter [-] [112604] Writing DB stats nova_api:SELECT=4 {{(pid=112604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:45:52.604919 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: worker 1 buried after 1 seconds Sep 11 08:45:52.604919 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: worker 2 buried after 1 seconds Sep 11 08:45:52.604919 dv-cinder-856941-2-iscsi devstack@n-api.service[112602]: goodbye to uWSGI. Sep 11 08:45:52.607327 dv-cinder-856941-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 11 08:45:52.607877 dv-cinder-856941-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 11 08:45:52.610763 dv-cinder-856941-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 11 08:45:52.622451 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 11 08:45:52.624441 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 08:45:52 2022] *** Sep 11 08:45:52.624441 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 08:45:52.624441 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 08:45:52.624441 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: nodename: dv-cinder-856941-2-iscsi Sep 11 08:45:52.624441 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: machine: x86_64 Sep 11 08:45:52.624441 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: clock source: unix Sep 11 08:45:52.624441 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: pcre jit disabled Sep 11 08:45:52.624441 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: detected number of CPU cores: 4 Sep 11 08:45:52.624441 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: current working directory: / Sep 11 08:45:52.624441 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: detected binary path: /usr/bin/uwsgi-core Sep 11 08:45:52.625285 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: your processes number limit is 47680 Sep 11 08:45:52.625285 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: your memory page size is 4096 bytes Sep 11 08:45:52.625285 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: detected max file descriptor number: 2048 Sep 11 08:45:52.625285 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: lock engine: pthread robust mutexes Sep 11 08:45:52.625285 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: thunder lock: enabled Sep 11 08:45:52.625285 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 11 08:45:52.625285 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 08:45:52.665310 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: Python main interpreter initialized at 0x55a34a8b09c0 Sep 11 08:45:52.665310 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: python threads support enabled Sep 11 08:45:52.665310 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: your server socket listen backlog is limited to 100 connections Sep 11 08:45:52.665310 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: your mercy for graceful operations on workers is 90 seconds Sep 11 08:45:52.665725 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 08:45:52.665825 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: *** Operational MODE: preforking *** Sep 11 08:45:52.666027 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: *** uWSGI is running in multiple interpreter mode *** Sep 11 08:45:52.666027 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: spawned uWSGI master process (pid: 127629) Sep 11 08:45:52.666296 dv-cinder-856941-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 11 08:45:52.673503 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: spawned uWSGI worker 1 (pid: 127646, cores: 1) Sep 11 08:45:52.673503 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: spawned uWSGI worker 2 (pid: 127647, cores: 1) Sep 11 08:45:52.673503 dv-cinder-856941-2-iscsi devstack@n-api.service[127629]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 08:45:53.336738 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 08:45:53.340296 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 11 08:45:54.526978 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:45:54.526978 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: from cryptography.utils import int_from_bytes Sep 11 08:45:54.527728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:45:54.527728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: from cryptography.utils import int_from_bytes Sep 11 08:45:54.528749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:45:54.528749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: from cryptography.utils import int_from_bytes Sep 11 08:45:54.529171 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 08:45:54.529171 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: from cryptography.utils import int_from_bytes Sep 11 08:45:56.961854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 08:45:56.962536 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 08:45:56.962632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 08:45:56.963022 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 08:45:56.963215 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 08:45:56.963555 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.963877 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.964196 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.964513 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.964788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 08:45:56.965164 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.965252 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 08:45:56.965334 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.965501 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.965601 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 08:45:56.965772 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.966527 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 08:45:56.966759 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 08:45:56.966872 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.967071 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.967191 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.967347 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.967455 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.967780 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.967953 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-2-iscsi {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.968108 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.968263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.968416 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.968558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.968712 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.968855 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.969005 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.969172 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.969327 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.969478 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.969648 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.969793 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.969950 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.970153 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.970322 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.970492 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.970718 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-2-iscsi {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.971057 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.971370 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.971688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.972015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.972347 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.972510 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.972681 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.972954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.973114 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.973467 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.973648 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.973794 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.974080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.974842 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.974983 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.974983 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.975152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.975234 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.975323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.975403 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.975475 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.975672 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.975814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.976069 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.976296 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.976455 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.976611 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.976787 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-2-iscsi {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.976951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.977097 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.977315 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-2-iscsi {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.977475 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.977691 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.977898 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.978046 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.978244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.978397 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.978567 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.978712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.978876 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.979137 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.979301 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.979454 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.979597 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.979740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.979897 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.980049 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.980250 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.980401 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.980552 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.980713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.980871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.982718 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.982897 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.983054 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.983209 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.983374 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.983519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.983663 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.983816 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.983968 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.984125 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.984290 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.984435 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.984918 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.985124 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.985273 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.985424 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.985586 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.985731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.985890 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.986040 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.986219 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.986448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.986594 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.986750 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.986900 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.987050 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.987050 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.987335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.987335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.987620 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.987763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.987907 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.988063 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.988218 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.988371 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.988522 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.988673 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.988824 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.989230 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.989382 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.989505 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.989623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.989735 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.989855 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.989978 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.990120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.995653 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.995874 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.996026 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.996196 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.996343 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.996488 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.996637 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.996870 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.997742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.997919 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.998268 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.998433 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.998590 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.998741 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.998893 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.999047 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.999047 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.999341 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.999341 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.999618 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.999770 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.999922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:56.999922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.000200 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.000343 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.000555 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.000714 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.000857 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.001011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.001164 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.001458 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.001867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.002083 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.002276 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.002462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.002616 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.002767 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.002918 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.003093 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.003246 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.003390 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.003531 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.003673 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.003822 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.003974 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.004128 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.004313 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.004460 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.004611 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.004764 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.005191 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.005463 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.005621 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.005765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.005918 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.006076 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.006285 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.006429 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.006571 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.006740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.007073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.007240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.007392 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.007542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.007703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.007854 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.008005 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.008160 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.008329 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.008476 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.008625 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.008767 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.008941 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.009104 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.009248 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.009391 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.009550 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.009693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.009854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.010005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.010186 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.010338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.010538 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.010695 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.010852 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.011005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.011148 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.011303 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.011551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.011951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.012123 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.012269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.012421 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.012564 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.012707 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.013478 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.013640 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.013785 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.013934 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.014077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.014260 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.014405 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.014573 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.014717 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.014867 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.015030 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.015397 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.015397 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.015808 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.015953 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.016113 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.016356 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.016529 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.016686 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.016839 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.016839 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.017128 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.017279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.017435 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.017593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.018135 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.018333 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.018480 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.018634 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.018779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.018931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.019083 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.019234 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.019388 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.019531 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.019672 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.019824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.019968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.020120 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.020263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.020412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.020614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.020763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.020915 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.021065 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.021224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.021376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.021552 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.021782 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.022214 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.022370 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.022526 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.022695 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 08:45:57.022967 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.023118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.023270 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.023421 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.023573 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.023811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.023965 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.024109 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.024258 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.024258 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.024545 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.024704 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.024848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.024999 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.025189 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.025583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.025744 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.025914 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.026194 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.026358 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.026504 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.026646 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.026788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.026943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.027178 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.027919 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.028085 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.028240 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.028407 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.028407 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.028694 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.028845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.029005 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.029005 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.029815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.029935 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.030056 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.030056 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.037997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.038207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.038374 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.038533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.038687 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.038831 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.038982 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.039134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.039278 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.039427 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.039570 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.039724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.039881 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.040033 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.040183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.040644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.040857 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.041018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.041172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.041315 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.041465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.041784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.042053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.042525 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.042625 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.042719 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.042805 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.042900 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.042991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.043090 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.043181 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.043266 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.043348 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.043431 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.043523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.043622 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.043721 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.043818 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.043923 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.044022 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.044125 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.044222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.044306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.044390 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.044479 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.044583 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.044683 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.044772 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.044865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.044958 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.045043 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.045127 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.045224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.045316 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.045401 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.045490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.045953 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.046095 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.046212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.046320 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.046415 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.046500 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.046584 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.046685 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.046777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.046877 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.046969 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.047054 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.047151 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.047245 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.047330 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.047413 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.047495 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.047585 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.047676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.047773 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.047858 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.047948 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.048039 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.048130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.048221 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.048318 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.048318 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.048479 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.048572 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.048655 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.048758 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.048843 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.048933 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049196 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049377 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049468 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049559 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049643 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049819 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.049995 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.050091 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.050229 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.050325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.050418 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.050510 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.050510 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.050663 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.050747 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.050860 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.050954 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.051039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.051121 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.051212 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.051307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.051406 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.051498 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.051589 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.051680 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.051772 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.051856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.051952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.052229 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.052349 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.052596 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.052686 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.052766 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.052902 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.052983 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.053065 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.053148 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.053230 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.053388 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.053475 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.053567 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.053652 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.053736 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.053819 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.053914 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.054010 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.054102 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.054281 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.054369 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.054452 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.054548 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.054633 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.054719 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.054803 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.054894 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.054987 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.055084 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.055176 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.055267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.055351 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.055441 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.055533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.055618 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.055708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.055792 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.055887 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.056112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.056219 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.056311 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.056404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.056496 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.056586 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.056677 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.056775 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.056849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.056941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.057025 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.057115 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.057199 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.057295 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.057387 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.057472 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.057562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.057653 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.057746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.057830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.057921 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.058005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.058095 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.058255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.058346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.058456 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.058542 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.058626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.058716 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.058834 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.058931 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.059024 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.059261 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.059356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.059448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.060071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.060172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.060255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.060346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.060438 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.060532 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.060627 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.060724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.060809 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.060900 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.060991 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061076 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061172 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061355 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061438 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061529 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061621 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061889 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061982 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.061982 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.062134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.062270 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.062354 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.062438 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.062696 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.063105 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.063209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.063298 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.063384 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.063474 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.063559 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.063641 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.063733 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.063930 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064103 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064177 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064256 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064411 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064641 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064805 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064877 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.064967 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065039 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065108 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065184 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065340 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065411 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065481 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065638 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065787 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065859 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.065929 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.066006 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.066339 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.066425 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.066498 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.066577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.066656 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.066729 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.066813 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.066886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.066967 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067048 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067128 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067208 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067295 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067369 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067439 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067509 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067579 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067663 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067737 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067838 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067916 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.067997 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068077 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068163 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068236 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068433 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068520 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068592 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068676 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068828 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068828 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.068964 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069235 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069307 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069377 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069449 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069607 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069898 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.069968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.070054 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.070127 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078182 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078302 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078472 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078563 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078638 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078711 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078797 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078884 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.078976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.079353 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.079436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.079436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.079600 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.079690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.079781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.079907 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080008 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080101 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080191 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080281 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080447 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080552 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080655 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080746 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080912 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.080994 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.081076 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.081173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.081267 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.081359 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.081443 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.081525 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.081622 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.081706 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.081796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.081879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.081951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.082028 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.082124 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.082241 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.082327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.082327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.082489 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.082575 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.082661 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.082767 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.082852 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.082931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083002 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083002 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083137 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083217 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083296 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083379 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083463 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083553 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083636 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083846 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.083946 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084124 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084124 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084284 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084374 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084457 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084541 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084631 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084727 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084893 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.084976 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.085065 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.085156 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.085247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.085339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.085428 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.085511 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.085601 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.085691 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.085787 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.085878 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.085960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.086247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.086370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.086482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.086564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.086645 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.086736 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.086827 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.086907 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087011 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087096 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087186 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087276 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087360 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087449 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087546 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087730 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087813 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087905 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.087996 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.088092 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.088183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.088272 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.088359 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.088439 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.088523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.088602 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.088673 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.088762 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.088846 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.088936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089033 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089141 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089222 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089301 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089384 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089467 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089642 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089727 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.089949 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090035 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090035 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090181 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090340 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090426 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090499 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090582 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090653 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090730 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090814 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.090945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.091057 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.091142 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.091225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.091304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.091376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.091504 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.091597 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.091683 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.091765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.091935 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.092081 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.092239 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.092338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.092549 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.092663 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.092854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.092959 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.093162 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.093318 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.093496 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.093645 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.093787 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.093936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.094075 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.094249 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.094386 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.094487 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.094689 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.094796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.094993 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.095085 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.095302 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.095395 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.095609 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.095713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.095913 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.096005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.096238 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.096353 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.096549 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.096690 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.096853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.096952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.097170 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.097279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.097463 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.097563 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.097765 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.097865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.098081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.098426 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.098616 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.098713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.098800 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.098875 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.098997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.099099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.099300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.099394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.099608 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.099709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.099915 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.100022 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.100217 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.100311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.100520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.100621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.100827 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.100935 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.101134 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.101234 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.101433 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.101582 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.101734 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.101889 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.102135 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.102302 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.102402 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.102496 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.102642 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.102749 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.102950 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.103054 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.103303 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.103398 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.103554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.103672 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.103851 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.103968 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.104196 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.104297 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.104500 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.104602 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.104859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.104952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.105176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.105275 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.105481 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.105565 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.105789 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.105892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.106098 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.106210 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.107215 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.107345 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.107521 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.107616 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.107825 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.107934 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.108140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.108233 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.108447 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.108711 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.108817 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.108944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.109101 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.109264 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.109404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.109589 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.109724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.109903 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.110037 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.110255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.110419 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.110575 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.110742 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.110896 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.111065 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.111207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.111388 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.111515 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.111691 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.111845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.111998 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.112166 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.112293 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.112483 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.112610 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.112810 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.112913 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.113137 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.113242 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.113466 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.113597 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.113776 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.113897 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.114082 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.126989 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.127107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.127223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.127361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.127504 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.127635 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.127743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.127830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.127925 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.128020 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.128106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.128198 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.128294 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.128388 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.128474 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.128573 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.128666 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.128751 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.128835 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.128932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129093 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129184 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129277 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129360 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129441 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129675 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129758 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129842 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.129939 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.130031 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.130124 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.130223 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.130308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.130410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.130496 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.130579 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.130671 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.130755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.130755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.130928 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131020 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131104 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131104 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131264 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131348 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131600 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131762 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.131946 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.132038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.132131 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.132221 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.132305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.132396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.132489 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.132574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.132664 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.132755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.132855 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.132949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.133067 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.133284 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.133372 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.133457 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.133551 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.133672 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.133748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.133843 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.133931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.134020 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.134101 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.134218 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.134314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.134399 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.134490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.134584 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.134678 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.134763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.134846 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.134936 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.135020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.135112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.135112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.135275 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.135358 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.135503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.135723 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.135827 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.135913 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.135997 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.136089 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.136174 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.136266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.136351 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.136442 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.136533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.136618 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.136701 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.136793 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.136884 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.136970 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.137061 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.137153 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.137238 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.137335 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.137420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.137514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.137587 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.137683 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.137779 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.137853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.137937 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.138031 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.138117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.138218 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.138322 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.138419 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.138512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.138604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.138688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.138778 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.138871 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.138957 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.139040 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.139120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.139120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.139263 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.139362 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.139450 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.139523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.139606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.139815 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.139929 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.140017 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.140102 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.140194 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.140287 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.140380 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.140479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.140571 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.140657 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.140749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.140847 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.140933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141026 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141122 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141208 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141476 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141570 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141650 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141734 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141825 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141825 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.142082 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.142190 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.142292 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.142387 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.142479 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.142573 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.142666 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.142750 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.142842 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.142933 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143018 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143110 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143202 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143319 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143400 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143485 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143575 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143672 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143764 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143852 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143926 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.143997 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.144083 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.144163 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.144235 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.144313 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.144398 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.144582 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.144695 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.144773 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.144885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.144979 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.145192 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.145313 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.145496 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.145655 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.145804 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.145993 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.146107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.146337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.146504 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.146680 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.146808 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.147016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.147108 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.147364 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.147469 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.147664 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.147814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.147988 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.148106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.148311 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.148419 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.148614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.148716 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.148923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.149016 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.149262 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.149355 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.149535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.149623 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.149841 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.149963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.150171 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.150273 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.150482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.150574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.150795 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157017 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157300 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157388 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157473 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157571 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.157969 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.158054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.158157 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.158247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.158332 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.158417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.158417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.158594 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.158688 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.158774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.158859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.158945 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.159047 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.159133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.159226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.159311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.159420 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.159502 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.159502 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.159685 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.159781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.159874 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.159966 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.160052 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.160134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.160234 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.160347 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.160445 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.160445 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.160609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.160777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.160872 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.160965 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.161062 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.161155 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.161253 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.161347 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.161433 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.161525 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.161617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.161737 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.161737 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.161924 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.161998 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.162082 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.162199 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.162298 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.162403 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.162490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.162574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.162658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.162758 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.162857 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.162942 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.163043 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.163129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.163215 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.163305 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.163400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.163660 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.163766 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.163853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.163954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.164204 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.164296 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.164396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.164489 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.164574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.164666 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.164760 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.164846 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.164919 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.164991 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165061 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165400 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165474 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165632 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165707 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165792 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165875 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.165973 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.166060 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.166176 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.166264 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.166482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.166590 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.166797 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.166905 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.167112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.167213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.167484 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.167634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.167908 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.168052 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.168207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.168311 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.168524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.168632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.168842 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.169477 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.169709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.169805 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.170023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.170119 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.170376 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.170482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.170683 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.170779 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.170993 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.171095 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.171304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.171399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.171613 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.171716 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.171918 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.172020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.172239 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.172503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.172596 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.172832 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.172933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.173443 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.173584 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.173862 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.173963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.173963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.174135 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.174389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.174489 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.174577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.174662 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.174831 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.174953 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.175147 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.175277 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.175464 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.175599 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.175784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.175890 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.176101 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.176196 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.176415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.176517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.176744 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.176847 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.177075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.177191 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.177374 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.177484 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.177692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.177802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.177978 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.178079 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.178322 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.178566 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.178674 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.178889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.178983 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.179197 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.179305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.179497 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.179609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.179823 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.179931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.180148 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.180247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.180438 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.180540 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.180748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.180850 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.181058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.181158 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.181361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.181463 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.181664 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.181758 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.181967 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.182073 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.182294 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.185706 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.185815 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.185904 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.185990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.186075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.186231 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.186343 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.186440 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.186527 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.186612 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.186719 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.186808 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.186902 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.186994 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.187080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.187164 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.187248 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.187601 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.187706 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.187793 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.187878 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.187971 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.188077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.188174 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.188261 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.188353 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.188438 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.188523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.188653 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.188832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.188941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.189036 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.189130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.189231 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.189326 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.189425 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.189511 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.189511 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.189854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.189957 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.190053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.190053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.190286 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.190286 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.190457 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.190551 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.190650 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.190736 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.190809 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.190892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.190982 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.191178 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.191300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.191498 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.191592 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.191810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.191903 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.192122 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.192233 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.192430 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.192524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.192739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.192841 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.193046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.193140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.193354 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.193447 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.193662 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.193932 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.194061 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.194299 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.194401 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.194629 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.194735 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.194965 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.195068 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.195272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.195379 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.195579 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.195682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.195887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.195994 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.196222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.196316 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.196526 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.196656 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.196834 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.196941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.197159 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.197261 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.197464 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.197574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.197779 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.197892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.198085 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.198211 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.198422 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.198591 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.198732 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.198827 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.199040 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.199145 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.199352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.199464 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.199667 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.199769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.199980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.200075 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.200879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.201001 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.201262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.201381 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.201512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.201607 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.201832 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.201940 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.202208 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.202325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.202537 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.202630 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.202859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.202961 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.203183 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.203277 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.203494 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.203593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.203809 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.203910 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.204118 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.204215 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.204431 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.204531 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.204748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.204855 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.205065 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.205166 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.205399 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.205506 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.205706 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.205800 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.206011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.206112 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.206341 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.206473 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.206664 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.206796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.207023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.207117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.207337 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.207528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.207637 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.207798 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.208086 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.208199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.208297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.208393 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.208525 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.208715 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.208814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.209044 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.209151 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.209362 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.209455 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.209697 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.209802 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.209997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.210094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.210323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.210430 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.210625 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.210720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.210932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.211034 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.211233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.211349 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.211538 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.211663 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.211847 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.218541 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.218654 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.218744 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.218849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.218939 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.219027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.219115 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.219207 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.219293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.219385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.219522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.219629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.219724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.219810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.219902 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.219988 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.220079 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.220172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.220254 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.220346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.220440 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.220533 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.220631 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.220724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.220824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.220911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.220995 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.221089 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.221191 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.221285 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.221379 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.221471 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.221590 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.221673 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.221835 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.221931 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.222018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.222103 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.222273 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.222417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.222526 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.222614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.222707 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.222799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.222892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.222991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.223085 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.223171 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.223263 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.223348 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.223443 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.223531 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.223614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.223699 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.223784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.223875 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.223962 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.224063 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.224150 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.224236 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.224331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.224424 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.224522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.224603 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.224684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.224775 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.224890 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.224972 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.225072 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.225154 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.225240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.225332 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.225332 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.225509 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.225603 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.225696 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.225782 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.225867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.225958 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.226052 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.226169 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.226270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.226364 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.226450 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.226534 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.226628 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.226714 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.226798 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.226889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.226970 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.227042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.227143 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.227235 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.227327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.227412 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.227496 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.227587 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.227680 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.227772 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.227858 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.227942 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.228202 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.228308 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.228396 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.228489 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.228580 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.228668 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.228750 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.228908 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 08:45:57.229080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.229385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.229701 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.230020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.230367 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.230695 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.231025 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.232593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.232593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.232788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.233117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.233469 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.233786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.234135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.234492 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.234890 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.235211 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.235521 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 08:45:57.235769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 08:45:57.292130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO dbcounter [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Registered counter for database nova_api Sep 11 08:45:57.299444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO dbcounter [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Registered counter for database nova_api Sep 11 08:45:57.312676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_db.sqlalchemy.engines [None req-70709c72-2b2b-4696-9942-019b9078347e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:45:57.319712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_db.sqlalchemy.engines [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:45:57.319937 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writer thread running {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:45:57.327513 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writer thread running {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:45:57.378632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.context [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),382ca797-322f-42ed-b065-8d7753b9f2b1(cell1) {{(pid=127647) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 08:45:57.382676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:45:57.383156 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:45:57.384704 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:45:57.384937 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.context [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),382ca797-322f-42ed-b065-8d7753b9f2b1(cell1) {{(pid=127646) load_cells /opt/stack/nova/nova/context.py:464}} Sep 11 08:45:57.385447 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:45:57.385891 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:45:57.387949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:45:57.388947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:45:57.389435 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:45:57.389976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO dbcounter [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Registered counter for database nova_cell0 Sep 11 08:45:57.391115 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:45:57.391896 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:45:57.392346 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:45:57.394008 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO dbcounter [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Registered counter for database nova_cell1 Sep 11 08:45:57.394371 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:45:57.396380 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO dbcounter [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Registered counter for database nova_cell0 Sep 11 08:45:57.400629 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO dbcounter [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Registered counter for database nova_cell1 Sep 11 08:45:57.401708 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_db.sqlalchemy.engines [None req-70709c72-2b2b-4696-9942-019b9078347e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:45:57.403515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_db.sqlalchemy.engines [None req-70709c72-2b2b-4696-9942-019b9078347e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:45:57.407955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_db.sqlalchemy.engines [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:45:57.408794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writer thread running {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:45:57.409328 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_db.sqlalchemy.engines [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:45:57.415827 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writer thread running {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:45:57.417451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writer thread running {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:45:57.553569 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writer thread running {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:45:57.563767 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO dbcounter [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Registered counter for database nova_cell0 Sep 11 08:45:57.569481 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO dbcounter [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Registered counter for database nova_cell0 Sep 11 08:45:57.571066 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_db.sqlalchemy.engines [None req-70709c72-2b2b-4696-9942-019b9078347e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:45:57.576892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writer thread running {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:45:57.581074 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_db.sqlalchemy.engines [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 08:45:57.585795 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writer thread running {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 08:45:57.900441 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: WARNING keystonemiddleware.auth_token [None req-70709c72-2b2b-4696-9942-019b9078347e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 08:45:57.908230 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: WARNING keystonemiddleware.auth_token [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 08:45:57.926937 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: WARNING keystonemiddleware.auth_token [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 08:45:57.934344 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: WARNING keystonemiddleware.auth_token [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 08:45:58.258513 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: WARNING keystonemiddleware.auth_token [None req-70709c72-2b2b-4696-9942-019b9078347e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 08:45:58.264578 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: WARNING keystonemiddleware.auth_token [None req-70709c72-2b2b-4696-9942-019b9078347e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 08:45:58.269859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a34a8b09c0 pid: 127647 (default app) Sep 11 08:45:58.289837 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: WARNING keystonemiddleware.auth_token [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 11 08:45:58.296817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: WARNING keystonemiddleware.auth_token [None req-63026b83-c5bb-46be-9e99-c6360b87366a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 11 08:45:58.302336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a34a8b09c0 pid: 127646 (default app) Sep 11 08:46:34.509601 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=3 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:34.510804 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=3 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:34.511650 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=3 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:34.512666 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=3 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:35.776709 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-50e4dc93-0a76-4ebd-82b2-0e0d248058ea tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] Action: 'create', calling method: .version_select at 0x7fb27fcca430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2099954062", "metadata": {"Type": "work"}}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:46:36.174424 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:36.175402 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:36.176363 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:36.177546 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:46:37.627255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4da0d334-ddec-44d5-b124-f4074b7c5aca tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Action: 'create', calling method: .version_select at 0x7fb27fccb430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-666863701", "metadata": {"Type": "work"}}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4da0d334-ddec-44d5-b124-f4074b7c5aca tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Request method failure captured: Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 121 Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaBsythDMW4Gbo7mjkUv_y6Mv8n2hANQ6forl1JsyP-6p8P8YE9nGpyPGVhuv7QsvKlTN7xI6LndFjyRbWed1Jju55zdR5l0MQCz1_-gW-AvYHNqgT2kkLLHAJ_1oc1HfrUE_iUNqomxDa_h7JYPxteshXHF5cyIlJ4Oi4LilnF2vb8 Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:46:37.639693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0db8bf71fdf848d3acbbd165481f143b", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c0013ae7efed4f35a66a27e4ef17f290 Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-666863701", "metadata": {"Type": "work"}}} Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: Sep 11 08:46:37.641314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-666863701', 'metadata': {'Type': 'work'}}}} Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise error Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi '#$%' Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:46:37.646571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 08:46:37.648723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 08:46:37.649888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 11 08:46:37.649888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.649888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4da0d334-ddec-44d5-b124-f4074b7c5aca tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:46:37.649888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4da0d334-ddec-44d5-b124-f4074b7c5aca tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.472360 Sep 11 08:46:37.649888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1156 bytes} [Sun Sep 11 08:46:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1477 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 11 08:46:37.656744 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c26c513f-586e-47d8-afd4-e8170426002d tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Action: 'create', calling method: .version_select at 0x7fb27fccbd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1961172756", "metadata": {"Type": "work"}}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c26c513f-586e-47d8-afd4-e8170426002d tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Request method failure captured: Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 120 Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaBsythDMW4Gbo7mjkUv_y6Mv8n2hANQ6forl1JsyP-6p8P8YE9nGpyPGVhuv7QsvKlTN7xI6LndFjyRbWed1Jju55zdR5l0MQCz1_-gW-AvYHNqgT2kkLLHAJ_1oc1HfrUE_iUNqomxDa_h7JYPxteshXHF5cyIlJ4Oi4LilnF2vb8 Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:46:37.661802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0db8bf71fdf848d3acbbd165481f143b", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c0013ae7efed4f35a66a27e4ef17f290 Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1961172756", "metadata": {"Type": "work"}}} Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: Sep 11 08:46:37.663796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1961172756', 'metadata': {'Type': 'work'}}}} Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise error Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi '0' Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:46:37.668817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 08:46:37.670724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 08:46:37.672041 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 11 08:46:37.672041 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:37.675179 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c26c513f-586e-47d8-afd4-e8170426002d tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:46:37.687420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c26c513f-586e-47d8-afd4-e8170426002d tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033113 Sep 11 08:46:37.689993 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 2/2] 10.222.0.44 () {60 vars in 1156 bytes} [Sun Sep 11 08:46:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 11 08:46:37.712293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1263737e-1b98-4786-a982-4bd7b4cabf93 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Action: 'create', calling method: .version_select at 0x7fb27fb85160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1894049351", "metadata": {"Type": "work"}}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1263737e-1b98-4786-a982-4bd7b4cabf93 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Request method failure captured: Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 119 Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaBsythDMW4Gbo7mjkUv_y6Mv8n2hANQ6forl1JsyP-6p8P8YE9nGpyPGVhuv7QsvKlTN7xI6LndFjyRbWed1Jju55zdR5l0MQCz1_-gW-AvYHNqgT2kkLLHAJ_1oc1HfrUE_iUNqomxDa_h7JYPxteshXHF5cyIlJ4Oi4LilnF2vb8 Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:46:37.722777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0db8bf71fdf848d3acbbd165481f143b", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c0013ae7efed4f35a66a27e4ef17f290 Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1894049351", "metadata": {"Type": "work"}}} Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: Sep 11 08:46:38.123410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1894049351', 'metadata': {'Type': 'work'}}}} Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise error Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi '' Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:46:38.128975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 11 08:46:38.137626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 11 08:46:38.143145 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 11 08:46:38.143145 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.143145 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1263737e-1b98-4786-a982-4bd7b4cabf93 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:46:38.143145 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1263737e-1b98-4786-a982-4bd7b4cabf93 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023857 Sep 11 08:46:38.143145 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 3/3] 10.222.0.44 () {60 vars in 1156 bytes} [Sun Sep 11 08:46:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 08:46:38.143145 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c7aa9c4f-fbe6-4926-a480-193afae2dc87 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Calling method '.version_select at 0x7fb27fb85b80>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:38.208355 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-c7aa9c4f-fbe6-4926-a480-193afae2dc87 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] HTTP exception thrown: Volume tempest-invalid-161818781 could not be found. Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c7aa9c4f-fbe6-4926-a480-193afae2dc87 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Request method failure captured: Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-161818781 HTTP/1.1 Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaBsythDMW4Gbo7mjkUv_y6Mv8n2hANQ6forl1JsyP-6p8P8YE9nGpyPGVhuv7QsvKlTN7xI6LndFjyRbWed1Jju55zdR5l0MQCz1_-gW-AvYHNqgT2kkLLHAJ_1oc1HfrUE_iUNqomxDa_h7JYPxteshXHF5cyIlJ4Oi4LilnF2vb8 Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:46:38.212339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0db8bf71fdf848d3acbbd165481f143b", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c0013ae7efed4f35a66a27e4ef17f290 Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Volume tempest-invalid-161818781 could not be found. Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'tempest-invalid-161818781'} Sep 11 08:46:38.213352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-161818781 could not be found. (HTTP 404) (Request-ID: req-2c60b5a6-2800-468a-8530-ddba9947bccd) Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:38.214121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 08:46:38.215087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-161818781 could not be found. Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:46:38.215955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-161818781 could not be found. Sep 11 08:46:38.216867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.216867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:38.216867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.216867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.216867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:38.216867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:38.216867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:46:38.216867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:46:38.216867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-161818781 could not be found. Sep 11 08:46:38.216867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.220211 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c7aa9c4f-fbe6-4926-a480-193afae2dc87 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Returning 404 to user: Volume tempest-invalid-161818781 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:46:38.221380 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c7aa9c4f-fbe6-4926-a480-193afae2dc87 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-161818781" status: 404 len: 98 microversion: 2.1 time: 0.487834 Sep 11 08:46:38.222671 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 4/4] 10.222.0.44 () {58 vars in 1215 bytes} [Sun Sep 11 08:46:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-161818781 => generated 98 bytes in 490 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 11 08:46:38.240590 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-90434cc1-af0e-4383-a5f9-1fe7594c2d93 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012499 Sep 11 08:46:38.242047 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 5/5] 10.222.0.44 () {58 vars in 1140 bytes} [Sun Sep 11 08:46:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 11 08:46:38.257996 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ab0e2278-e46b-4830-bf5f-6217cb624611 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005748 Sep 11 08:46:38.258562 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 6/6] 10.222.0.44 () {58 vars in 1137 bytes} [Sun Sep 11 08:46:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 11 08:46:38.286051 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5b52a58a-9551-4aac-913e-2a6e48363c24 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Calling method '.version_select at 0x7fb27fb0be50>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:38.378326 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-5b52a58a-9551-4aac-913e-2a6e48363c24 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] HTTP exception thrown: Volume f5789f7d-a03e-4274-8714-933eddb8b5e8 could not be found. Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5b52a58a-9551-4aac-913e-2a6e48363c24 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Request method failure captured: Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: DELETE /compute/v2.1/os-volumes/f5789f7d-a03e-4274-8714-933eddb8b5e8 HTTP/1.1 Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaBsythDMW4Gbo7mjkUv_y6Mv8n2hANQ6forl1JsyP-6p8P8YE9nGpyPGVhuv7QsvKlTN7xI6LndFjyRbWed1Jju55zdR5l0MQCz1_-gW-AvYHNqgT2kkLLHAJ_1oc1HfrUE_iUNqomxDa_h7JYPxteshXHF5cyIlJ4Oi4LilnF2vb8 Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:46:38.389134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0db8bf71fdf848d3acbbd165481f143b", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c0013ae7efed4f35a66a27e4ef17f290 Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Volume f5789f7d-a03e-4274-8714-933eddb8b5e8 could not be found. Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'f5789f7d-a03e-4274-8714-933eddb8b5e8'} Sep 11 08:46:38.390338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5789f7d-a03e-4274-8714-933eddb8b5e8 could not be found. (HTTP 404) (Request-ID: req-31bba661-ca25-4a7f-9454-b6ab2cd16b4d) Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:38.397708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 08:46:38.398674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5789f7d-a03e-4274-8714-933eddb8b5e8 could not be found. Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 08:46:38.399548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5789f7d-a03e-4274-8714-933eddb8b5e8 could not be found. Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5789f7d-a03e-4274-8714-933eddb8b5e8 could not be found. Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5b52a58a-9551-4aac-913e-2a6e48363c24 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Returning 404 to user: Volume f5789f7d-a03e-4274-8714-933eddb8b5e8 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5b52a58a-9551-4aac-913e-2a6e48363c24 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/f5789f7d-a03e-4274-8714-933eddb8b5e8" status: 404 len: 109 microversion: 2.1 time: 0.124279 Sep 11 08:46:38.400414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 7/7] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 08:46:38 2022] DELETE /compute/v2.1/os-volumes/f5789f7d-a03e-4274-8714-933eddb8b5e8 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:46:38.402907 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-827fb12e-9088-4b11-9459-516057f5ded2 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Calling method '.version_select at 0x7fb27fabb5e0>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:38.498312 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-827fb12e-9088-4b11-9459-516057f5ded2 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] HTTP exception thrown: Volume c5915e9d-1232-4a03-85f4-fdd9c30fdfae could not be found. Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-827fb12e-9088-4b11-9459-516057f5ded2 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Request method failure captured: Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/os-volumes/c5915e9d-1232-4a03-85f4-fdd9c30fdfae HTTP/1.1 Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaBsythDMW4Gbo7mjkUv_y6Mv8n2hANQ6forl1JsyP-6p8P8YE9nGpyPGVhuv7QsvKlTN7xI6LndFjyRbWed1Jju55zdR5l0MQCz1_-gW-AvYHNqgT2kkLLHAJ_1oc1HfrUE_iUNqomxDa_h7JYPxteshXHF5cyIlJ4Oi4LilnF2vb8 Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:46:38.500732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0db8bf71fdf848d3acbbd165481f143b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0db8bf71fdf848d3acbbd165481f143b", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 0db8bf71fdf848d3acbbd165481f143b Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-VolumesNegativeTest-1161069463 Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c0013ae7efed4f35a66a27e4ef17f290 Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-VolumesNegativeTest-1161069463-project Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Volume c5915e9d-1232-4a03-85f4-fdd9c30fdfae could not be found. Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'c5915e9d-1232-4a03-85f4-fdd9c30fdfae'} Sep 11 08:46:38.501760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c5915e9d-1232-4a03-85f4-fdd9c30fdfae could not be found. (HTTP 404) (Request-ID: req-1b0eae1a-7bd4-44e4-86ae-98cbd4d8772e) Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:38.502574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 08:46:38.503441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c5915e9d-1232-4a03-85f4-fdd9c30fdfae could not be found. Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 08:46:38.506002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c5915e9d-1232-4a03-85f4-fdd9c30fdfae could not be found. Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c5915e9d-1232-4a03-85f4-fdd9c30fdfae could not be found. Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-827fb12e-9088-4b11-9459-516057f5ded2 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] Returning 404 to user: Volume c5915e9d-1232-4a03-85f4-fdd9c30fdfae could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:46:38.509383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-827fb12e-9088-4b11-9459-516057f5ded2 tempest-VolumesNegativeTest-1161069463 tempest-VolumesNegativeTest-1161069463-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c5915e9d-1232-4a03-85f4-fdd9c30fdfae" status: 404 len: 109 microversion: 2.1 time: 0.104115 Sep 11 08:46:38.512151 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 8/8] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:46:38 2022] GET /compute/v2.1/os-volumes/c5915e9d-1232-4a03-85f4-fdd9c30fdfae => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 08:46:38.596828 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-50e4dc93-0a76-4ebd-82b2-0e0d248058ea tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.097288 Sep 11 08:46:38.597826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 1/9] 10.222.0.44 () {60 vars in 1156 bytes} [Sun Sep 11 08:46:34 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4102 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 11 08:46:38.614710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-03c3379c-9d37-40e5-a62a-9b11fd1782bd tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] Calling method '.version_select at 0x7fb27fb0bd30>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:38.692293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-03c3379c-9d37-40e5-a62a-9b11fd1782bd tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601" status: 200 len: 353 microversion: 2.1 time: 0.082309 Sep 11 08:46:38.692923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 9/10] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:46:38 2022] GET /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:46:39.708967 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-15f351e1-dbe7-471b-8aed-989d735158ba tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] Calling method '.version_select at 0x7fb27fb9f310>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:39.805742 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-15f351e1-dbe7-471b-8aed-989d735158ba tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601" status: 200 len: 354 microversion: 2.1 time: 0.101619 Sep 11 08:46:39.806676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 2/11] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:46:39 2022] GET /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:46:39.825477 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2c5fc7e0-22ba-4ffc-ae4b-476812cc837a tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] Calling method '.version_select at 0x7fb27fabb3a0>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:39.937159 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2c5fc7e0-22ba-4ffc-ae4b-476812cc837a tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601" status: 200 len: 354 microversion: 2.1 time: 0.120614 Sep 11 08:46:39.937859 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 10/12] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:46:39 2022] GET /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601 => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:46:39.961954 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-fca154a9-1665-44d1-aeaf-a720a9477ea3 tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] Calling method '.version_select at 0x7fb27fb9f9d0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:40.272984 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-914e2e89-9a07-4542-a7df-d2e4e7c36fc4 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] Calling method '.version_select at 0x7fb27fac20d0>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:40.309454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-fca154a9-1665-44d1-aeaf-a720a9477ea3 tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601" status: 202 len: 0 microversion: 2.1 time: 0.352776 Sep 11 08:46:40.310011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 3/13] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 08:46:39 2022] DELETE /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:46:40.329117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5f75df0a-9103-4af8-a533-23493befd311 tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] Calling method '.version_select at 0x7fb27fb3a0d0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:40.370622 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-914e2e89-9a07-4542-a7df-d2e4e7c36fc4 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9a0cefe2-8e73-4b2a-bb39-a5269d07c32b" status: 200 len: 350 microversion: 2.1 time: 0.101381 Sep 11 08:46:40.371609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 11/14] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:46:40 2022] GET /compute/v2.1/os-volumes/9a0cefe2-8e73-4b2a-bb39-a5269d07c32b => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:46:40.431686 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5f75df0a-9103-4af8-a533-23493befd311 tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601" status: 200 len: 353 microversion: 2.1 time: 0.110815 Sep 11 08:46:40.434588 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 4/15] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:46:40 2022] GET /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:46:41.447758 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c613d949-a890-40b0-8ea7-ebdd52d57577 tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] Calling method '.version_select at 0x7fb27fabb820>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:41.853437 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-c613d949-a890-40b0-8ea7-ebdd52d57577 tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] HTTP exception thrown: Volume 6c650973-6879-43d3-9741-c442c7e88601 could not be found. Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c613d949-a890-40b0-8ea7-ebdd52d57577 tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] Request method failure captured: Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601 HTTP/1.1 Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaBq-ObuWdzg1wR5rtr8jUZD_fxtXbPaK9lYwu4IaFU9mcjTCALWVElacG2DMTZeItC2nnm2BG1f-tI1L_7sm_oxXvjOusuzhv8OAGQ6X-K8P09M9O8ccxghLzXWQZVP-m8aEIW1FYabUCvHFaC4lPYkRjxN_USsVHst4SVL07UKq1Y Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: f96c7a52c30e4043908a94348eb6af9b Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-VolumesGetTestJSON-1468065862 Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:46:41.857338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f96c7a52c30e4043908a94348eb6af9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f96c7a52c30e4043908a94348eb6af9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f96c7a52c30e4043908a94348eb6af9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f96c7a52c30e4043908a94348eb6af9b", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-VolumesGetTestJSON-1468065862 Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: f96c7a52c30e4043908a94348eb6af9b Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-VolumesGetTestJSON-1468065862 Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-VolumesGetTestJSON-1468065862-project Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: ca42316192ec4c62b98ead2e7d659880 Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-VolumesGetTestJSON-1468065862-project Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Volume 6c650973-6879-43d3-9741-c442c7e88601 could not be found. Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': '6c650973-6879-43d3-9741-c442c7e88601'} Sep 11 08:46:41.858688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c650973-6879-43d3-9741-c442c7e88601 could not be found. (HTTP 404) (Request-ID: req-8941e905-ea66-4083-b696-c993e01bca09) Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:41.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 08:46:41.860311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c650973-6879-43d3-9741-c442c7e88601 could not be found. Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 08:46:41.861199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:46:41.862094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c650973-6879-43d3-9741-c442c7e88601 could not be found. Sep 11 08:46:41.862094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:41.862094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:46:41.862094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:41.862094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:46:41.862094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:46:41.862094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:46:41.862094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:46:41.862094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:46:41.862094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c650973-6879-43d3-9741-c442c7e88601 could not be found. Sep 11 08:46:41.862094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:46:41.866101 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c613d949-a890-40b0-8ea7-ebdd52d57577 tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] Returning 404 to user: Volume 6c650973-6879-43d3-9741-c442c7e88601 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:46:41.867551 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c613d949-a890-40b0-8ea7-ebdd52d57577 tempest-VolumesGetTestJSON-1468065862 tempest-VolumesGetTestJSON-1468065862-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601" status: 404 len: 109 microversion: 2.1 time: 0.423982 Sep 11 08:46:41.868293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 12/16] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:46:41 2022] GET /compute/v2.1/os-volumes/6c650973-6879-43d3-9741-c442c7e88601 => generated 109 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:46:42.739258 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1e6f987e-3766-40b2-b00a-2d08f2e16f04 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] Calling method '.version_select at 0x7fb27fb9fd30>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:42.868046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1e6f987e-3766-40b2-b00a-2d08f2e16f04 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/43549a63-d8de-4e6d-ae4c-3741c2f3f374" status: 200 len: 350 microversion: 2.1 time: 0.134431 Sep 11 08:46:42.868609 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 5/17] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:46:42 2022] GET /compute/v2.1/os-volumes/43549a63-d8de-4e6d-ae4c-3741c2f3f374 => generated 350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:46:45.183587 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f4a5a2bb-eb88-405c-afef-37a9585bce41 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] Calling method '.version_select at 0x7fb27fac2430>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:45.345699 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f4a5a2bb-eb88-405c-afef-37a9585bce41 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9395e7d1-907d-4a31-9d86-08330206e4ac" status: 200 len: 351 microversion: 2.1 time: 0.168980 Sep 11 08:46:45.347179 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 13/18] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:46:45 2022] GET /compute/v2.1/os-volumes/9395e7d1-907d-4a31-9d86-08330206e4ac => generated 351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:46:45.362703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5a8e0be5-2bbd-42bd-9b0d-96de8860ae98 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] Calling method '.version_select at 0x7fb27fb9f5e0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:45.637183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5a8e0be5-2bbd-42bd-9b0d-96de8860ae98 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.278602 Sep 11 08:46:45.638254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 6/19] 10.222.0.44 () {58 vars in 1134 bytes} [Sun Sep 11 08:46:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:46:45.654058 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-bc31f4fd-e9f9-45b5-bec5-043941a308e3 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] Calling method '.version_select at 0x7fb27fb0be50>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:45.925267 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-bc31f4fd-e9f9-45b5-bec5-043941a308e3 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.276184 Sep 11 08:46:45.926492 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 14/20] 10.222.0.44 () {58 vars in 1149 bytes} [Sun Sep 11 08:46:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:46:45.959558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bc4f43ef-dfab-421a-8b21-e64ed4eea29e tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] Calling method '.version_select at 0x7fb27fb3aca0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:46.245054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bc4f43ef-dfab-421a-8b21-e64ed4eea29e tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.308350 Sep 11 08:46:46.246509 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 7/21] 10.222.0.44 () {58 vars in 1134 bytes} [Sun Sep 11 08:46:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:46:46.280840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-26b1dad4-5a47-407a-896d-abf644953413 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] Calling method '.version_select at 0x7fb27fac23a0>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:46.783039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-26b1dad4-5a47-407a-896d-abf644953413 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.515422 Sep 11 08:46:46.784484 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 15/22] 10.222.0.44 () {58 vars in 1167 bytes} [Sun Sep 11 08:46:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:46:46.806477 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-59d6fa03-6e9a-4ca1-b9a0-e48b097c2171 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] Calling method '.version_select at 0x7fb27fb9f1f0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:47.147903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-59d6fa03-6e9a-4ca1-b9a0-e48b097c2171 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.350721 Sep 11 08:46:47.167099 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 8/23] 10.222.0.44 () {58 vars in 1170 bytes} [Sun Sep 11 08:46:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:46:47.181031 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-111cb6b8-679b-4dc3-a69e-e46fc9273910 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] Calling method '.version_select at 0x7fb27faca790>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:47.407825 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-111cb6b8-679b-4dc3-a69e-e46fc9273910 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.230081 Sep 11 08:46:47.410934 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 16/24] 10.222.0.44 () {58 vars in 1155 bytes} [Sun Sep 11 08:46:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:46:47.440432 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2deffa65-a2aa-403f-9bd8-526c1a98b9ea tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] Calling method '.version_select at 0x7fb27fb3a940>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:47.809817 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2deffa65-a2aa-403f-9bd8-526c1a98b9ea tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.387117 Sep 11 08:46:47.811166 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 9/25] 10.222.0.44 () {58 vars in 1188 bytes} [Sun Sep 11 08:46:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:46:47.826478 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-96662879-3ebd-4d62-bf74-e11ee15bd2a9 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] Calling method '.version_select at 0x7fb27fabb700>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:48.107692 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-96662879-3ebd-4d62-bf74-e11ee15bd2a9 tempest-VolumesTestJSON-59103501 tempest-VolumesTestJSON-59103501-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.285265 Sep 11 08:46:48.123927 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 17/26] 10.222.0.44 () {58 vars in 1155 bytes} [Sun Sep 11 08:46:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:46:50.165173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-37576487", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "networks": [{"uuid": "659a4806-3869-4446-9939-364b81db816d"}]}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:46:50.400604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.network.neutron [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] validate_networks() for [('659a4806-3869-4446-9939-364b81db816d', None, None, None, None, None)] {{(pid=127647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:46:53.119716 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Flavor limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:46:53.122015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Image limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:46:53.122688 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Flavor pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:46:53.123417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Image pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:46:53.123972 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:46:53.157795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:46:53.165130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:46:53.165130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:46:53.170395 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:46:53.172481 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:46:53.172881 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:46:53.326622 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Getting quotas for project 7df041c538da419d8576d746b392c4db. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:46:53.342085 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Getting quotas for user 00407384465c41848ad28a15729a95d6 and project 7df041c538da419d8576d746b392c4db. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:46:53.367077 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Going to run 1 instances... {{(pid=127647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:46:53.372936 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:46:53.618673 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2bb743df-8f76-43ef-be5d-e3d32f064f14 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.194722 Sep 11 08:46:53.621059 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 10/27] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:46:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:46:53.636765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-18225409-16a7-4248-a764-aa94283d56bb tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:53.637536 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-18225409-16a7-4248-a764-aa94283d56bb tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:46:54.144750 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-18225409-16a7-4248-a764-aa94283d56bb tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:46:54.184416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-18225409-16a7-4248-a764-aa94283d56bb tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1213 microversion: 2.1 time: 0.548824 Sep 11 08:46:54.185951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 18/28] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:46:53 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1213 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:46:55.216394 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5ee1a1e3-ea87-4eb7-81a2-d503bf350341 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:55.217178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5ee1a1e3-ea87-4eb7-81a2-d503bf350341 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:46:55.807969 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-20010ea1-e8b4-4e89-b499-ab5ccb03bfff tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Action: 'create', calling method: .version_select at 0x7fb27fac2040>, body: {"keypair": {"name": "tempest-keypair-492733929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcApTyyKyW01m/t9kW7TDnXx4mir5AAziZ1I0ryVR0DvVvJnuDT7Dmz1sVwvEVDBeMRXl1FNMXTOzyFtWJy6W/czGD2ccUzpFmVXjEVSiv4+h/M4fhJ3mMEopB7io/Eqw=="}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:46:55.915000 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-20010ea1-e8b4-4e89-b499-ab5ccb03bfff tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Getting quotas for project 018b87eeeda248e4a85f587c31e297f4. Resources: {'key_pairs'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:46:55.935408 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-20010ea1-e8b4-4e89-b499-ab5ccb03bfff tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Getting quotas for user 64ea6fbc6e7d42dabdf459e8de4c3621 and project 018b87eeeda248e4a85f587c31e297f4. Resources: {'key_pairs'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:46:55.980879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5ee1a1e3-ea87-4eb7-81a2-d503bf350341 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:46:56.047510 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5ee1a1e3-ea87-4eb7-81a2-d503bf350341 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1213 microversion: 2.1 time: 0.831704 Sep 11 08:46:56.053907 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 11/29] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:46:55 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1213 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:46:56.201427 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-20010ea1-e8b4-4e89-b499-ab5ccb03bfff tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.641846 Sep 11 08:46:56.202619 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 19/30] 10.222.0.44 () {62 vars in 1200 bytes} [Sun Sep 11 08:46:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 645 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 11 08:46:56.966681 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-267453943", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:46:57.113720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9a55496c-554a-47bc-a7f1-d5e7b175f798 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:57.121222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9a55496c-554a-47bc-a7f1-d5e7b175f798 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:46:57.146743 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.network.neutron [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] validate_networks() for [('048ca4a6-429d-4b77-b6ad-109011048383', None, None, None, None, None)] {{(pid=127647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:46:57.242646 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9a55496c-554a-47bc-a7f1-d5e7b175f798 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:46:57.257459 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9a55496c-554a-47bc-a7f1-d5e7b175f798 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1213 microversion: 2.1 time: 0.161472 Sep 11 08:46:57.262215 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 20/31] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:46:57 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1213 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:46:58.300227 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7d59a06f-66d6-470b-ac34-eeaba20515c1 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:46:58.301328 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7d59a06f-66d6-470b-ac34-eeaba20515c1 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:46:58.337810 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d59a06f-66d6-470b-ac34-eeaba20515c1 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:46:58.347631 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d59a06f-66d6-470b-ac34-eeaba20515c1 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:46:58.350201 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d59a06f-66d6-470b-ac34-eeaba20515c1 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:46:58.353778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d59a06f-66d6-470b-ac34-eeaba20515c1 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:46:58.357747 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d59a06f-66d6-470b-ac34-eeaba20515c1 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:46:58.359280 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d59a06f-66d6-470b-ac34-eeaba20515c1 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:46:59.349744 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7d59a06f-66d6-470b-ac34-eeaba20515c1 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:46:59.405353 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7d59a06f-66d6-470b-ac34-eeaba20515c1 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1265 microversion: 2.1 time: 1.102706 Sep 11 08:46:59.410973 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 21/32] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:46:58 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1265 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:00.288220 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Flavor limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:47:00.291317 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Image limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:47:00.292073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Flavor pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:47:00.292831 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Image pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:47:00.294738 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:47:00.385176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:00.386411 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:00.387648 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:00.389488 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:00.390953 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:00.391988 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:00.443634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Getting quotas for project bcb554b6cf504ca9a30a1ea871364e3d. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:47:00.461736 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b3ed1cb9-db71-491d-9738-d29e2947b867 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:00.466807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b3ed1cb9-db71-491d-9738-d29e2947b867 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:00.489643 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Getting quotas for user 2aea4a0e0ec74c538735b890fb774b14 and project bcb554b6cf504ca9a30a1ea871364e3d. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:47:00.510466 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3ed1cb9-db71-491d-9738-d29e2947b867 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:00.515118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3ed1cb9-db71-491d-9738-d29e2947b867 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:00.517190 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3ed1cb9-db71-491d-9738-d29e2947b867 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:00.520316 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3ed1cb9-db71-491d-9738-d29e2947b867 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:00.522287 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3ed1cb9-db71-491d-9738-d29e2947b867 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:00.527742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3ed1cb9-db71-491d-9738-d29e2947b867 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:00.543836 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Going to run 1 instances... {{(pid=127647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:47:00.554359 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:47:00.837700 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6e1e1da4-a70a-46a3-9c41-1527a71a2864 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.134235 Sep 11 08:47:00.892080 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 12/33] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:46:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 4179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:47:01.576761 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-90e6d8f3-f718-467e-a35a-fcf76d4619d7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Action: 'create', calling method: .version_select at 0x7fb27f26c940>, body: {"keypair": {"name": "tempest-keypair-176508027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhio72vM+0uJstFBrhe6Mkvy2lBJXc1CPS87SvPrDnwQb39CZivCdRDzEVkEZC/8mMGEE1UPq/WS/bUMUU9rYG7VNZwLpckCZMymGz16vBtqIKBtRDI/CIa8s0V4arVzw=="}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:01.590411 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b3ed1cb9-db71-491d-9738-d29e2947b867 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:01.628040 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b3ed1cb9-db71-491d-9738-d29e2947b867 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1273 microversion: 2.1 time: 1.174879 Sep 11 08:47:01.633926 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 22/34] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:00 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1273 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:01.653526 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a201579e-7b6a-4f31-9617-e826d5715881 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:01.653526 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a201579e-7b6a-4f31-9617-e826d5715881 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:01.765740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-90e6d8f3-f718-467e-a35a-fcf76d4619d7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Getting quotas for project 347504c603af4937b829f24349b013c2. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:47:01.789723 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-90e6d8f3-f718-467e-a35a-fcf76d4619d7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Getting quotas for user 3abba619decf448db477533c663004bb and project 347504c603af4937b829f24349b013c2. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:47:02.015180 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-90e6d8f3-f718-467e-a35a-fcf76d4619d7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.131720 Sep 11 08:47:02.023490 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 13/35] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 08:47:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:02.258944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a201579e-7b6a-4f31-9617-e826d5715881 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:02.289947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a201579e-7b6a-4f31-9617-e826d5715881 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1221 microversion: 2.1 time: 0.647465 Sep 11 08:47:02.313623 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 23/36] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:01 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1221 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:02.681549 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f5625492-f8af-4262-a998-112120c78ddf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:02.693700 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f5625492-f8af-4262-a998-112120c78ddf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:02.706540 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5625492-f8af-4262-a998-112120c78ddf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:02.707579 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5625492-f8af-4262-a998-112120c78ddf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:02.710238 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5625492-f8af-4262-a998-112120c78ddf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:02.712038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5625492-f8af-4262-a998-112120c78ddf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:02.716668 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5625492-f8af-4262-a998-112120c78ddf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:02.719088 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5625492-f8af-4262-a998-112120c78ddf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:02.809075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-8568715", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:03.064915 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] validate_networks() for [('048ca4a6-429d-4b77-b6ad-109011048383', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:47:03.629945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f5625492-f8af-4262-a998-112120c78ddf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:03.735401 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f5625492-f8af-4262-a998-112120c78ddf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1271 microversion: 2.1 time: 1.055728 Sep 11 08:47:03.745431 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 14/37] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:02 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1271 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:04.774692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bc0a7754-a77b-43c1-9b1f-a2bfec038efa tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:04.778998 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bc0a7754-a77b-43c1-9b1f-a2bfec038efa tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:04.823857 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc0a7754-a77b-43c1-9b1f-a2bfec038efa tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:04.841546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc0a7754-a77b-43c1-9b1f-a2bfec038efa tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:04.849641 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc0a7754-a77b-43c1-9b1f-a2bfec038efa tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:04.850713 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc0a7754-a77b-43c1-9b1f-a2bfec038efa tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:04.851641 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc0a7754-a77b-43c1-9b1f-a2bfec038efa tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:04.852397 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc0a7754-a77b-43c1-9b1f-a2bfec038efa tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:05.376591 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bc0a7754-a77b-43c1-9b1f-a2bfec038efa tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:05.386755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bc0a7754-a77b-43c1-9b1f-a2bfec038efa tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1271 microversion: 2.1 time: 0.619458 Sep 11 08:47:05.397441 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 15/38] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:04 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1271 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:06.426791 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-99e490f4-341d-4a16-b487-1d11a8ae8108 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:06.427521 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-99e490f4-341d-4a16-b487-1d11a8ae8108 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:06.438818 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99e490f4-341d-4a16-b487-1d11a8ae8108 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:06.439936 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99e490f4-341d-4a16-b487-1d11a8ae8108 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:06.440606 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99e490f4-341d-4a16-b487-1d11a8ae8108 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:06.444957 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99e490f4-341d-4a16-b487-1d11a8ae8108 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:06.445863 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99e490f4-341d-4a16-b487-1d11a8ae8108 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:06.447888 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99e490f4-341d-4a16-b487-1d11a8ae8108 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:07.451071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:47:07.451071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:47:07.451071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:47:07.451071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:47:07.451071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:47:07.455689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:07.455689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:07.455689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:07.455689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:07.458206 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:07.458206 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:07.608812 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Getting quotas for project bcb554b6cf504ca9a30a1ea871364e3d. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:47:07.623606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Getting quotas for user 2aea4a0e0ec74c538735b890fb774b14 and project bcb554b6cf504ca9a30a1ea871364e3d. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:47:07.657031 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-99e490f4-341d-4a16-b487-1d11a8ae8108 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:07.683259 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-99e490f4-341d-4a16-b487-1d11a8ae8108 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1271 microversion: 2.1 time: 1.254427 Sep 11 08:47:07.685012 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 16/39] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:06 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1271 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:07.728236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:47:07.744226 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:47:07.745962 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-222962351", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5be8985a-737b-46de-bef6-189240965867"}], "security_groups": [{"name": "tempest-securitygroup--2081736063"}], "key_name": "tempest-keypair-492733929", "user_data": "}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:08.181286 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1b9e5cc8-a38d-4c05-b897-8b32e1b9a626 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.373118 Sep 11 08:47:08.187200 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 24/40] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:47:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 5385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:47:08.210529 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-74dd2776-83b8-484b-aad4-5c3987e1e614 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:08.217598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-74dd2776-83b8-484b-aad4-5c3987e1e614 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:08.794084 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.network.neutron [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] validate_networks() for [('5be8985a-737b-46de-bef6-189240965867', None, None, None, None, None)] {{(pid=127647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:47:09.568913 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-74dd2776-83b8-484b-aad4-5c3987e1e614 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:09.583136 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-74dd2776-83b8-484b-aad4-5c3987e1e614 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1219 microversion: 2.1 time: 1.387742 Sep 11 08:47:09.611041 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 25/41] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:08 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1219 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:09.623817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-10364e11-9c74-4ce0-8ab4-15c29a526165 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:09.631518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-10364e11-9c74-4ce0-8ab4-15c29a526165 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:09.668842 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10364e11-9c74-4ce0-8ab4-15c29a526165 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:09.669540 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10364e11-9c74-4ce0-8ab4-15c29a526165 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:09.673574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10364e11-9c74-4ce0-8ab4-15c29a526165 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:09.676006 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10364e11-9c74-4ce0-8ab4-15c29a526165 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:09.676982 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10364e11-9c74-4ce0-8ab4-15c29a526165 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:09.680037 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10364e11-9c74-4ce0-8ab4-15c29a526165 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:10.411962 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=4 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:10.809607 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-10364e11-9c74-4ce0-8ab4-15c29a526165 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:10.832600 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-10364e11-9c74-4ce0-8ab4-15c29a526165 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 1.220119 Sep 11 08:47:10.851771 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 26/42] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:09 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:10.889494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5ad863e8-ae93-4858-821b-94760a6f7e1c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:10.890909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5ad863e8-ae93-4858-821b-94760a6f7e1c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:11.009465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Flavor limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:47:11.010795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Image limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:47:11.011610 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Flavor pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:47:11.012751 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Image pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:47:11.013628 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:47:11.046822 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:11.047616 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:11.048443 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:11.049714 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:11.050742 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:11.056403 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:11.132776 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Getting quotas for project 018b87eeeda248e4a85f587c31e297f4. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:47:11.154690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Getting quotas for user 64ea6fbc6e7d42dabdf459e8de4c3621 and project 018b87eeeda248e4a85f587c31e297f4. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:47:11.198972 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Going to run 1 instances... {{(pid=127647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:47:11.208187 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:47:11.350505 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5ad863e8-ae93-4858-821b-94760a6f7e1c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:11.384068 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5ad863e8-ae93-4858-821b-94760a6f7e1c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1219 microversion: 2.1 time: 0.529842 Sep 11 08:47:11.384903 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 27/43] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:10 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1219 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:11.741001 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-09a2d43e-64a1-4d11-ac9e-08b889c9581c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.049696 Sep 11 08:47:11.747558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 17/44] 10.222.0.44 () {62 vars in 1188 bytes} [Sun Sep 11 08:47:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 4060 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 11 08:47:11.785125 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7d139b2f-f868-4c3b-a1f2-9f4a582df243 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:11.786661 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7d139b2f-f868-4c3b-a1f2-9f4a582df243 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:11.884733 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e0bed256-34b7-4099-812f-ac67ce9ba4a0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:11.906568 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e0bed256-34b7-4099-812f-ac67ce9ba4a0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:11.925784 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0bed256-34b7-4099-812f-ac67ce9ba4a0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:11.927141 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0bed256-34b7-4099-812f-ac67ce9ba4a0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:11.928982 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0bed256-34b7-4099-812f-ac67ce9ba4a0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:11.931890 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0bed256-34b7-4099-812f-ac67ce9ba4a0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:11.951585 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0bed256-34b7-4099-812f-ac67ce9ba4a0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:11.953269 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0bed256-34b7-4099-812f-ac67ce9ba4a0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:12.493192 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e0bed256-34b7-4099-812f-ac67ce9ba4a0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:12.517242 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e0bed256-34b7-4099-812f-ac67ce9ba4a0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.656103 Sep 11 08:47:12.527048 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 18/45] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:11 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:12.543240 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ce78d8b0-3687-4918-8363-b9487a3921c2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:12.544653 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ce78d8b0-3687-4918-8363-b9487a3921c2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:12.558096 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce78d8b0-3687-4918-8363-b9487a3921c2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:12.567789 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce78d8b0-3687-4918-8363-b9487a3921c2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:12.568634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce78d8b0-3687-4918-8363-b9487a3921c2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:12.569731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce78d8b0-3687-4918-8363-b9487a3921c2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:12.576202 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce78d8b0-3687-4918-8363-b9487a3921c2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:12.576202 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce78d8b0-3687-4918-8363-b9487a3921c2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:12.622947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7d139b2f-f868-4c3b-a1f2-9f4a582df243 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:12.699797 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7d139b2f-f868-4c3b-a1f2-9f4a582df243 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:12.705257 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7d139b2f-f868-4c3b-a1f2-9f4a582df243 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:12.717824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7d139b2f-f868-4c3b-a1f2-9f4a582df243 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1280 microversion: 2.20 time: 0.960657 Sep 11 08:47:12.739789 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 28/46] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:11 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1280 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:12.769968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ce78d8b0-3687-4918-8363-b9487a3921c2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:12.786405 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ce78d8b0-3687-4918-8363-b9487a3921c2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1271 microversion: 2.1 time: 0.252814 Sep 11 08:47:12.787228 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 19/47] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:12 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1271 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:13.572395 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fc2d0d83-0d94-48a9-94d7-f4fbb1c30122 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:13.575240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-fc2d0d83-0d94-48a9-94d7-f4fbb1c30122 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:13.596307 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fc2d0d83-0d94-48a9-94d7-f4fbb1c30122 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:13.598485 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fc2d0d83-0d94-48a9-94d7-f4fbb1c30122 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:13.617825 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fc2d0d83-0d94-48a9-94d7-f4fbb1c30122 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:13.641243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fc2d0d83-0d94-48a9-94d7-f4fbb1c30122 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:13.647237 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fc2d0d83-0d94-48a9-94d7-f4fbb1c30122 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:13.649964 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fc2d0d83-0d94-48a9-94d7-f4fbb1c30122 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:13.781954 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5fc6a7d8-5642-4f09-8885-c79734db841a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:13.783427 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5fc6a7d8-5642-4f09-8885-c79734db841a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:14.720494 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5fc6a7d8-5642-4f09-8885-c79734db841a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:14.765374 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5fc6a7d8-5642-4f09-8885-c79734db841a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:14.779781 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5fc6a7d8-5642-4f09-8885-c79734db841a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:14.788475 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5fc6a7d8-5642-4f09-8885-c79734db841a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1280 microversion: 2.20 time: 1.016572 Sep 11 08:47:14.834994 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 20/48] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:13 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1280 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:14.845300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9033d5d0-0a3c-49c0-bf87-dc6a62b163a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:14.847033 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9033d5d0-0a3c-49c0-bf87-dc6a62b163a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:14.862456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9033d5d0-0a3c-49c0-bf87-dc6a62b163a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:14.863694 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9033d5d0-0a3c-49c0-bf87-dc6a62b163a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:14.864761 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9033d5d0-0a3c-49c0-bf87-dc6a62b163a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:14.866493 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9033d5d0-0a3c-49c0-bf87-dc6a62b163a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:14.867606 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9033d5d0-0a3c-49c0-bf87-dc6a62b163a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:14.869013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9033d5d0-0a3c-49c0-bf87-dc6a62b163a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:15.152868 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fc2d0d83-0d94-48a9-94d7-f4fbb1c30122 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:15.204816 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-fc2d0d83-0d94-48a9-94d7-f4fbb1c30122 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 1.642446 Sep 11 08:47:15.211925 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 29/49] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:13 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:15.486709 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-9033d5d0-0a3c-49c0-bf87-dc6a62b163a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:15.515330 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=41 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:15.527416 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9033d5d0-0a3c-49c0-bf87-dc6a62b163a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1277 microversion: 2.1 time: 0.690146 Sep 11 08:47:15.528544 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 21/50] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:14 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1277 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:15.843300 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:15.844164 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:15.869883 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:15.869883 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:15.869883 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:15.880415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:15.881676 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:15.884401 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:16.259180 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-74aa00e2-d47d-41f2-972f-b35b4dc0b111 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:16.261184 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-74aa00e2-d47d-41f2-972f-b35b4dc0b111 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:16.272301 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=10 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:16.292053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74aa00e2-d47d-41f2-972f-b35b4dc0b111 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:16.294404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74aa00e2-d47d-41f2-972f-b35b4dc0b111 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:16.317027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74aa00e2-d47d-41f2-972f-b35b4dc0b111 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:16.321038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74aa00e2-d47d-41f2-972f-b35b4dc0b111 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:16.322082 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74aa00e2-d47d-41f2-972f-b35b4dc0b111 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:16.323541 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74aa00e2-d47d-41f2-972f-b35b4dc0b111 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:16.555080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:16.598788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:16.600636 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:16.601957 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a9195f6c-32ca-49b2-80de-d73661467bb6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1276 microversion: 2.20 time: 0.764370 Sep 11 08:47:16.613656 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 30/51] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:15 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1276 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:16.622533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-78ba2f36-0769-4488-b2ef-7f68ab11f210 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:16.623499 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-78ba2f36-0769-4488-b2ef-7f68ab11f210 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:16.643223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:16.647780 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-78ba2f36-0769-4488-b2ef-7f68ab11f210 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:16.649033 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-78ba2f36-0769-4488-b2ef-7f68ab11f210 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:16.649714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-78ba2f36-0769-4488-b2ef-7f68ab11f210 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:16.651345 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-78ba2f36-0769-4488-b2ef-7f68ab11f210 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:16.652730 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-78ba2f36-0769-4488-b2ef-7f68ab11f210 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:16.653429 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-78ba2f36-0769-4488-b2ef-7f68ab11f210 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:16.994139 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-78ba2f36-0769-4488-b2ef-7f68ab11f210 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:17.010535 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-78ba2f36-0769-4488-b2ef-7f68ab11f210 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1277 microversion: 2.1 time: 0.394706 Sep 11 08:47:17.011171 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 31/52] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:16 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1277 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:17.636487 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:17.637169 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:17.684648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:17.695558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:17.701793 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:17.702665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:17.712129 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:17.714824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:17.717870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:18.302890 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-74aa00e2-d47d-41f2-972f-b35b4dc0b111 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:18.318588 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-74aa00e2-d47d-41f2-972f-b35b4dc0b111 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 2.066818 Sep 11 08:47:18.321224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 22/53] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:16 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:18.340446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-950c1b45-e40e-4db6-b1c7-ead4f2dac9c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:18.345147 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-950c1b45-e40e-4db6-b1c7-ead4f2dac9c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:18.366567 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-950c1b45-e40e-4db6-b1c7-ead4f2dac9c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:18.373554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-950c1b45-e40e-4db6-b1c7-ead4f2dac9c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:18.373554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-950c1b45-e40e-4db6-b1c7-ead4f2dac9c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:18.373554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-950c1b45-e40e-4db6-b1c7-ead4f2dac9c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:18.373554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-950c1b45-e40e-4db6-b1c7-ead4f2dac9c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:18.378439 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-950c1b45-e40e-4db6-b1c7-ead4f2dac9c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:18.706405 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-950c1b45-e40e-4db6-b1c7-ead4f2dac9c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:18.748212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-950c1b45-e40e-4db6-b1c7-ead4f2dac9c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1277 microversion: 2.1 time: 0.420781 Sep 11 08:47:18.756806 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 23/54] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:18 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1277 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:18.868555 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:18.884436 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:18.886509 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:18.902125 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c3d4ea58-a751-4db1-82ab-6f63bccb12bb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1340 microversion: 2.20 time: 1.256660 Sep 11 08:47:18.903409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 32/55] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:17 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1340 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:47:19.373723 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b0ac708e-e50b-4cd6-bfdf-57f8e2930e57 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:19.396293 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b0ac708e-e50b-4cd6-bfdf-57f8e2930e57 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:19.437550 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0ac708e-e50b-4cd6-bfdf-57f8e2930e57 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:19.438598 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0ac708e-e50b-4cd6-bfdf-57f8e2930e57 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:19.442831 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0ac708e-e50b-4cd6-bfdf-57f8e2930e57 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:19.464734 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0ac708e-e50b-4cd6-bfdf-57f8e2930e57 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:19.471140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0ac708e-e50b-4cd6-bfdf-57f8e2930e57 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:19.473416 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0ac708e-e50b-4cd6-bfdf-57f8e2930e57 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:19.785327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e94b4870-fcee-4f98-b25e-7da9212fb6f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:19.786353 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e94b4870-fcee-4f98-b25e-7da9212fb6f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:19.856938 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e94b4870-fcee-4f98-b25e-7da9212fb6f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:19.877455 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e94b4870-fcee-4f98-b25e-7da9212fb6f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:19.878591 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e94b4870-fcee-4f98-b25e-7da9212fb6f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:19.879974 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e94b4870-fcee-4f98-b25e-7da9212fb6f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:19.880793 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e94b4870-fcee-4f98-b25e-7da9212fb6f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:19.889592 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e94b4870-fcee-4f98-b25e-7da9212fb6f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:20.863167 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b0ac708e-e50b-4cd6-bfdf-57f8e2930e57 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:20.913304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b0ac708e-e50b-4cd6-bfdf-57f8e2930e57 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 1.547764 Sep 11 08:47:20.916815 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 24/56] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:19 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:20.955671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:20.957343 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:20.973429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:20.975069 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:20.975869 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:20.977601 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:20.978463 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:20.979961 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:21.080349 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:21.165675 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:21.195096 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:21.204901 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:21.222949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a2a688ff-c815-491f-ba48-fc94f6adcbfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1338 microversion: 2.20 time: 0.288485 Sep 11 08:47:21.225096 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 25/57] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:20 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1338 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:21.659292 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e94b4870-fcee-4f98-b25e-7da9212fb6f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:21.675390 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e94b4870-fcee-4f98-b25e-7da9212fb6f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 1.895953 Sep 11 08:47:21.675390 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 33/58] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:19 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:21.961405 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3f98ab73-51a9-415d-a648-a976afbf84f0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:21.962098 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3f98ab73-51a9-415d-a648-a976afbf84f0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:21.984659 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f98ab73-51a9-415d-a648-a976afbf84f0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:21.985345 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f98ab73-51a9-415d-a648-a976afbf84f0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:21.985853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f98ab73-51a9-415d-a648-a976afbf84f0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:21.986636 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f98ab73-51a9-415d-a648-a976afbf84f0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:21.987104 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f98ab73-51a9-415d-a648-a976afbf84f0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:21.987533 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f98ab73-51a9-415d-a648-a976afbf84f0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:22.138223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-332574688", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fe0fa1a-815d-4049-afc0-259e74885d31"}], "security_groups": [{"name": "tempest-securitygroup--7713729"}], "key_name": "tempest-keypair-176508027", "user_data": "}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:22.614759 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3f98ab73-51a9-415d-a648-a976afbf84f0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:22.630724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3f98ab73-51a9-415d-a648-a976afbf84f0 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.675169 Sep 11 08:47:22.631752 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 26/59] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:21 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:22.653932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:22.655242 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:22.670879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:22.674692 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=22 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:22.677592 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:22.678605 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:22.679804 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:22.682920 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:22.683802 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:23.019807 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:23.035316 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:23.039532 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:23.043737 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d635ff93-5fd3-4f66-a202-fd52965d4a1c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1338 microversion: 2.20 time: 0.410284 Sep 11 08:47:23.047383 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 27/60] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:22 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1338 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:23.065208 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-04210d5f-b5e9-40d3-9577-a27864343e00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:23.067309 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-04210d5f-b5e9-40d3-9577-a27864343e00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:23.086442 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-04210d5f-b5e9-40d3-9577-a27864343e00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:23.090341 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-04210d5f-b5e9-40d3-9577-a27864343e00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:23.091420 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-04210d5f-b5e9-40d3-9577-a27864343e00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:23.105019 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-04210d5f-b5e9-40d3-9577-a27864343e00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:23.106509 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-04210d5f-b5e9-40d3-9577-a27864343e00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:23.107284 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-04210d5f-b5e9-40d3-9577-a27864343e00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:23.244650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] validate_networks() for [('0fe0fa1a-815d-4049-afc0-259e74885d31', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:47:23.675616 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-04210d5f-b5e9-40d3-9577-a27864343e00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:23.704021 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-04210d5f-b5e9-40d3-9577-a27864343e00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.652856 Sep 11 08:47:23.719127 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 28/61] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:23 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:24.412205 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-f6c37537-7875-42f2-ac37-a4fa4cb8b252 req-2891df5b-8a9e-43c9-8cab-9ec33ed1d0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76ea279-a179-4979-aa4f-e7cde772d1ee", "tag": "d7f6207c-9831-44fb-9769-1349bbe6e4a7"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:24.490793 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-f6c37537-7875-42f2-ac37-a4fa4cb8b252 req-2891df5b-8a9e-43c9-8cab-9ec33ed1d0c0 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:24.490793 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-f6c37537-7875-42f2-ac37-a4fa4cb8b252 req-2891df5b-8a9e-43c9-8cab-9ec33ed1d0c0 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:24.490793 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-f6c37537-7875-42f2-ac37-a4fa4cb8b252 req-2891df5b-8a9e-43c9-8cab-9ec33ed1d0c0 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:24.572377 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-f6c37537-7875-42f2-ac37-a4fa4cb8b252 req-2891df5b-8a9e-43c9-8cab-9ec33ed1d0c0 service nova] Creating event network-changed:d7f6207c-9831-44fb-9769-1349bbe6e4a7 for instance c76ea279-a179-4979-aa4f-e7cde772d1ee on hv-cinder-85694 Sep 11 08:47:24.576149 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-f6c37537-7875-42f2-ac37-a4fa4cb8b252 req-2891df5b-8a9e-43c9-8cab-9ec33ed1d0c0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 08:47:24.576585 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-f6c37537-7875-42f2-ac37-a4fa4cb8b252 req-2891df5b-8a9e-43c9-8cab-9ec33ed1d0c0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 08:47:24.577731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dc2525ce-54b6-4f41-87b2-87554c3f93bc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:24.578825 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dc2525ce-54b6-4f41-87b2-87554c3f93bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:24.580820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dc2525ce-54b6-4f41-87b2-87554c3f93bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:24.581693 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dc2525ce-54b6-4f41-87b2-87554c3f93bc None None] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:24.584436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dc2525ce-54b6-4f41-87b2-87554c3f93bc None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:24.586614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dc2525ce-54b6-4f41-87b2-87554c3f93bc None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:24.621539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.compute.rpcapi [None req-dc2525ce-54b6-4f41-87b2-87554c3f93bc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 08:47:24.621539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dc2525ce-54b6-4f41-87b2-87554c3f93bc None None] Releasing lock "compute-rpcapi-router" {{(pid=127647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 08:47:24.660436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-dc2525ce-54b6-4f41-87b2-87554c3f93bc None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.930973 Sep 11 08:47:24.662203 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 29/62] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:24.684010 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-76baae1f-f080-468d-af42-8b7fd6220719 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:24.685103 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-76baae1f-f080-468d-af42-8b7fd6220719 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:24.694486 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76baae1f-f080-468d-af42-8b7fd6220719 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:24.704285 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76baae1f-f080-468d-af42-8b7fd6220719 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:24.704285 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76baae1f-f080-468d-af42-8b7fd6220719 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:24.704285 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76baae1f-f080-468d-af42-8b7fd6220719 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:24.704285 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76baae1f-f080-468d-af42-8b7fd6220719 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:24.704774 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76baae1f-f080-468d-af42-8b7fd6220719 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:24.753006 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=26 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:26.187720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-76baae1f-f080-468d-af42-8b7fd6220719 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:26.204309 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-76baae1f-f080-468d-af42-8b7fd6220719 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 1.540023 Sep 11 08:47:26.206918 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 30/63] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:24 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:26.216244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:26.220186 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:26.257143 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:26.260608 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:26.261060 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:26.261820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:26.262328 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:26.262759 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:26.699679 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:47:26.699679 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:47:26.701761 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:47:26.713412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:47:26.713412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:47:26.717644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:26.719035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:26.720029 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:26.721176 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:26.722556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:26.723422 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:26.738056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:26.748730 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:26.756744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:26.758331 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e39d55e4-272e-4323-b6a5-6f5915ee933a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.548305 Sep 11 08:47:26.762013 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Getting quotas for project 347504c603af4937b829f24349b013c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:47:26.770747 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Getting quotas for user 3abba619decf448db477533c663004bb and project 347504c603af4937b829f24349b013c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:47:26.776074 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 31/64] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:26 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:26.812294 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:47:26.835221 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:47:27.007380 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-425696a0-9231-40d4-b695-b66c9b248494 req-6dd5eadd-595d-40ea-af86-dff6641b7fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ab3837-2058-4f46-8361-2535358fced8", "tag": "a4e1aef8-2ebd-4142-9d16-5aae187c8a59"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:27.020231 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-425696a0-9231-40d4-b695-b66c9b248494 req-6dd5eadd-595d-40ea-af86-dff6641b7fd2 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:27.021123 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-425696a0-9231-40d4-b695-b66c9b248494 req-6dd5eadd-595d-40ea-af86-dff6641b7fd2 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:27.021799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-425696a0-9231-40d4-b695-b66c9b248494 req-6dd5eadd-595d-40ea-af86-dff6641b7fd2 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:27.037360 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-425696a0-9231-40d4-b695-b66c9b248494 req-6dd5eadd-595d-40ea-af86-dff6641b7fd2 service nova] Creating event network-changed:a4e1aef8-2ebd-4142-9d16-5aae187c8a59 for instance 18ab3837-2058-4f46-8361-2535358fced8 on hv-cinder-85694 Sep 11 08:47:27.046656 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-425696a0-9231-40d4-b695-b66c9b248494 req-6dd5eadd-595d-40ea-af86-dff6641b7fd2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268350 Sep 11 08:47:27.060204 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 32/65] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:27.068477 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bc9b44f5-5899-45d4-900d-6746ac1328bc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:27.069554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bc9b44f5-5899-45d4-900d-6746ac1328bc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:27.082046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc9b44f5-5899-45d4-900d-6746ac1328bc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:27.082722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc9b44f5-5899-45d4-900d-6746ac1328bc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:27.083173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc9b44f5-5899-45d4-900d-6746ac1328bc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:27.086193 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc9b44f5-5899-45d4-900d-6746ac1328bc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:27.090541 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc9b44f5-5899-45d4-900d-6746ac1328bc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:27.095830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc9b44f5-5899-45d4-900d-6746ac1328bc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:27.408569 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0ddb9165-0a74-4653-8594-c0b46cd056c5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 5.274575 Sep 11 08:47:27.420827 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:47:22 2022] POST /compute/v2.1/servers => generated 399 bytes in 5278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:47:27.430375 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-bc09a55d-baa7-4228-a64b-ef8d1a85b7ce req-e2419c2c-1e5d-4d2f-808c-88858a4b1b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bbdc2f9-9111-44ca-b51e-5af1c6069184", "tag": "ac147de6-ab9b-409f-8399-16076fabf055"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:27.457534 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-bc09a55d-baa7-4228-a64b-ef8d1a85b7ce req-e2419c2c-1e5d-4d2f-808c-88858a4b1b96 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:27.458359 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-bc09a55d-baa7-4228-a64b-ef8d1a85b7ce req-e2419c2c-1e5d-4d2f-808c-88858a4b1b96 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:27.459125 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-bc09a55d-baa7-4228-a64b-ef8d1a85b7ce req-e2419c2c-1e5d-4d2f-808c-88858a4b1b96 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:27.493974 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=53 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:27.518184 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-bc09a55d-baa7-4228-a64b-ef8d1a85b7ce req-e2419c2c-1e5d-4d2f-808c-88858a4b1b96 service nova] Creating event network-changed:ac147de6-ab9b-409f-8399-16076fabf055 for instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 on hv-cinder-85694 Sep 11 08:47:27.518731 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-bc09a55d-baa7-4228-a64b-ef8d1a85b7ce req-e2419c2c-1e5d-4d2f-808c-88858a4b1b96 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127646) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 11 08:47:27.519120 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-bc09a55d-baa7-4228-a64b-ef8d1a85b7ce req-e2419c2c-1e5d-4d2f-808c-88858a4b1b96 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127646) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 11 08:47:27.520213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8312d77-8abf-47e9-9d3a-04c63e4496bc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:27.520677 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8312d77-8abf-47e9-9d3a-04c63e4496bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:27.526092 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8312d77-8abf-47e9-9d3a-04c63e4496bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:27.527698 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8312d77-8abf-47e9-9d3a-04c63e4496bc None None] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:27.528521 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8312d77-8abf-47e9-9d3a-04c63e4496bc None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:27.529099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8312d77-8abf-47e9-9d3a-04c63e4496bc None None] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:27.530447 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bc9b44f5-5899-45d4-900d-6746ac1328bc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:27.543535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bc9b44f5-5899-45d4-900d-6746ac1328bc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.481501 Sep 11 08:47:27.560229 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 33/67] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:27 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:27.576337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.compute.rpcapi [None req-b8312d77-8abf-47e9-9d3a-04c63e4496bc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 11 08:47:27.580902 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b90dd7b0-b1f6-45b3-bfe7-20309cf407e2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:27.581574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b90dd7b0-b1f6-45b3-bfe7-20309cf407e2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:27.586058 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8312d77-8abf-47e9-9d3a-04c63e4496bc None None] Releasing lock "compute-rpcapi-router" {{(pid=127646) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 11 08:47:27.597674 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b90dd7b0-b1f6-45b3-bfe7-20309cf407e2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:27.598918 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b90dd7b0-b1f6-45b3-bfe7-20309cf407e2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:27.602723 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b90dd7b0-b1f6-45b3-bfe7-20309cf407e2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:27.604422 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b90dd7b0-b1f6-45b3-bfe7-20309cf407e2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:27.606349 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b90dd7b0-b1f6-45b3-bfe7-20309cf407e2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:27.611856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b90dd7b0-b1f6-45b3-bfe7-20309cf407e2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:27.630308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b8312d77-8abf-47e9-9d3a-04c63e4496bc None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217906 Sep 11 08:47:27.631387 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 35/68] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:27.657594 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f1a5d151-55c4-432c-b3f6-e9493aa33235 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:27.663649 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f1a5d151-55c4-432c-b3f6-e9493aa33235 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:27.873413 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b90dd7b0-b1f6-45b3-bfe7-20309cf407e2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:27.891394 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b90dd7b0-b1f6-45b3-bfe7-20309cf407e2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.322833 Sep 11 08:47:27.893674 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 34/69] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:27 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:27.922527 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:27.923928 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:27.935708 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:27.936569 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:27.938012 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:27.939712 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:27.940820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:27.941778 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:27.964326 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f1a5d151-55c4-432c-b3f6-e9493aa33235 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:27.974838 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f1a5d151-55c4-432c-b3f6-e9493aa33235 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1236 microversion: 2.1 time: 0.341612 Sep 11 08:47:27.976738 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 36/70] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:27 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1236 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:28.171798 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:28.196563 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:28.204878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:28.209911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-dd942d47-b90a-49df-a7dc-09e006430adf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.313953 Sep 11 08:47:28.210967 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 35/71] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:27 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:28.579455 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6694419e-1655-48ae-be15-365bdea5cb09 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:28.583991 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6694419e-1655-48ae-be15-365bdea5cb09 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:28.594181 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6694419e-1655-48ae-be15-365bdea5cb09 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:28.595082 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6694419e-1655-48ae-be15-365bdea5cb09 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:28.595858 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6694419e-1655-48ae-be15-365bdea5cb09 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:28.597130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6694419e-1655-48ae-be15-365bdea5cb09 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:28.597950 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6694419e-1655-48ae-be15-365bdea5cb09 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:28.598744 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6694419e-1655-48ae-be15-365bdea5cb09 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:28.921591 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9d864a57-7bc9-4df9-ba31-849672e8cb4d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:28.930493 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9d864a57-7bc9-4df9-ba31-849672e8cb4d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:28.931085 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d864a57-7bc9-4df9-ba31-849672e8cb4d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:28.932634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d864a57-7bc9-4df9-ba31-849672e8cb4d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:28.933246 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d864a57-7bc9-4df9-ba31-849672e8cb4d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:28.934117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d864a57-7bc9-4df9-ba31-849672e8cb4d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:28.934738 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d864a57-7bc9-4df9-ba31-849672e8cb4d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:28.935396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d864a57-7bc9-4df9-ba31-849672e8cb4d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:28.951305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6694419e-1655-48ae-be15-365bdea5cb09 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:28.991875 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6694419e-1655-48ae-be15-365bdea5cb09 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.421244 Sep 11 08:47:29.028801 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 37/72] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:28 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:29.028801 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-14fb1c3b-7d8d-4456-979b-65b7354711e8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:29.028801 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-14fb1c3b-7d8d-4456-979b-65b7354711e8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:29.116220 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-14fb1c3b-7d8d-4456-979b-65b7354711e8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:29.135552 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-14fb1c3b-7d8d-4456-979b-65b7354711e8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1236 microversion: 2.1 time: 0.125230 Sep 11 08:47:29.136737 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 38/73] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:29 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1236 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:29.192045 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-9d864a57-7bc9-4df9-ba31-849672e8cb4d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:29.214100 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9d864a57-7bc9-4df9-ba31-849672e8cb4d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.298762 Sep 11 08:47:29.227570 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 36/74] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:28 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:29.239529 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:29.240151 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:29.251884 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:29.252391 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:29.252839 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:29.253598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:29.254046 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:29.254512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:29.472440 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:29.492209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:29.496641 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:29.498408 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c02700e0-8055-4146-8f64-78149b23cd2d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.262599 Sep 11 08:47:29.499561 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 39/75] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:29 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:29.761508 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-710894ac-75cb-42de-917a-dcf60e7ce12e req-24ce1cb6-3d6b-4260-ad12-dfcf9b552059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223e4b7b-8a6c-4647-aa91-aae73dbeb340", "tag": "a3c9ee62-2858-49c8-b169-41636e1c8bdd"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:29.798417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-710894ac-75cb-42de-917a-dcf60e7ce12e req-24ce1cb6-3d6b-4260-ad12-dfcf9b552059 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:29.799294 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-710894ac-75cb-42de-917a-dcf60e7ce12e req-24ce1cb6-3d6b-4260-ad12-dfcf9b552059 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:29.800071 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-710894ac-75cb-42de-917a-dcf60e7ce12e req-24ce1cb6-3d6b-4260-ad12-dfcf9b552059 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:29.837678 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-710894ac-75cb-42de-917a-dcf60e7ce12e req-24ce1cb6-3d6b-4260-ad12-dfcf9b552059 service nova] Creating event network-changed:a3c9ee62-2858-49c8-b169-41636e1c8bdd for instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 on hv-cinder-85694 Sep 11 08:47:29.860325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-710894ac-75cb-42de-917a-dcf60e7ce12e req-24ce1cb6-3d6b-4260-ad12-dfcf9b552059 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105700 Sep 11 08:47:29.861341 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 37/76] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:30.071097 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-63b5004b-9c63-4bc9-b3f4-0e5003727f63 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:30.072192 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-63b5004b-9c63-4bc9-b3f4-0e5003727f63 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:30.100516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63b5004b-9c63-4bc9-b3f4-0e5003727f63 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:30.109385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63b5004b-9c63-4bc9-b3f4-0e5003727f63 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:30.109385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63b5004b-9c63-4bc9-b3f4-0e5003727f63 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:30.109385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63b5004b-9c63-4bc9-b3f4-0e5003727f63 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:30.109385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63b5004b-9c63-4bc9-b3f4-0e5003727f63 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:30.109763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63b5004b-9c63-4bc9-b3f4-0e5003727f63 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:30.174385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a74243a5-6f4c-4529-9a3c-90daedaa0cb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:30.175720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a74243a5-6f4c-4529-9a3c-90daedaa0cb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:30.185134 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a74243a5-6f4c-4529-9a3c-90daedaa0cb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:30.188280 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a74243a5-6f4c-4529-9a3c-90daedaa0cb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:30.190194 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a74243a5-6f4c-4529-9a3c-90daedaa0cb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:30.194669 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a74243a5-6f4c-4529-9a3c-90daedaa0cb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:30.195298 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a74243a5-6f4c-4529-9a3c-90daedaa0cb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:30.195949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a74243a5-6f4c-4529-9a3c-90daedaa0cb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:30.368352 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a74243a5-6f4c-4529-9a3c-90daedaa0cb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:30.379890 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a74243a5-6f4c-4529-9a3c-90daedaa0cb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1240 microversion: 2.1 time: 0.219307 Sep 11 08:47:30.383557 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 38/77] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:30 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1240 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:30.401868 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a0a1b867-4ac8-4b72-b190-31cf40f288cf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:30.403185 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a0a1b867-4ac8-4b72-b190-31cf40f288cf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:30.425942 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a0a1b867-4ac8-4b72-b190-31cf40f288cf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:30.426201 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a0a1b867-4ac8-4b72-b190-31cf40f288cf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:30.426864 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a0a1b867-4ac8-4b72-b190-31cf40f288cf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:30.427788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a0a1b867-4ac8-4b72-b190-31cf40f288cf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:30.428441 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a0a1b867-4ac8-4b72-b190-31cf40f288cf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:30.430712 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a0a1b867-4ac8-4b72-b190-31cf40f288cf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:30.685215 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-63b5004b-9c63-4bc9-b3f4-0e5003727f63 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:30.697205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-63b5004b-9c63-4bc9-b3f4-0e5003727f63 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.632361 Sep 11 08:47:30.698722 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 40/78] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:30 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:30.705032 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:30.705423 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:30.713133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:30.717956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:30.717956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:30.717956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:30.717956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:30.718587 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:30.719580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a0a1b867-4ac8-4b72-b190-31cf40f288cf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:30.728730 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a0a1b867-4ac8-4b72-b190-31cf40f288cf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.343017 Sep 11 08:47:30.729308 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 39/79] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:30 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:30.884846 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:30.893991 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:30.896052 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:30.897358 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2da24c72-faab-42e9-998a-eded31b895ae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.197211 Sep 11 08:47:30.897992 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 41/80] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:30 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:31.425909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-12ee6bbd-f268-4af9-b7e4-ac344e5a3d06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:31.429797 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-12ee6bbd-f268-4af9-b7e4-ac344e5a3d06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:31.458532 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12ee6bbd-f268-4af9-b7e4-ac344e5a3d06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:31.461519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12ee6bbd-f268-4af9-b7e4-ac344e5a3d06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:31.464904 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12ee6bbd-f268-4af9-b7e4-ac344e5a3d06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:31.466343 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12ee6bbd-f268-4af9-b7e4-ac344e5a3d06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:31.467444 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12ee6bbd-f268-4af9-b7e4-ac344e5a3d06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:31.468436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12ee6bbd-f268-4af9-b7e4-ac344e5a3d06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:31.479474 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=100 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:31.747377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a0206a7a-9e2c-49c9-9f53-7dafc5222eed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:31.748863 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a0206a7a-9e2c-49c9-9f53-7dafc5222eed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:31.776679 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0206a7a-9e2c-49c9-9f53-7dafc5222eed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:31.779636 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0206a7a-9e2c-49c9-9f53-7dafc5222eed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:31.782474 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0206a7a-9e2c-49c9-9f53-7dafc5222eed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:31.784223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0206a7a-9e2c-49c9-9f53-7dafc5222eed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:31.788318 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0206a7a-9e2c-49c9-9f53-7dafc5222eed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:31.791429 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0206a7a-9e2c-49c9-9f53-7dafc5222eed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:32.373979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-12ee6bbd-f268-4af9-b7e4-ac344e5a3d06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:32.373979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-12ee6bbd-f268-4af9-b7e4-ac344e5a3d06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1288 microversion: 2.1 time: 0.927556 Sep 11 08:47:32.373979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 40/81] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:31 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1288 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:32.373979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-fb18f94f-303a-4e95-a19e-f13b8b987f75 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:32.374670 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-fb18f94f-303a-4e95-a19e-f13b8b987f75 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:32.376236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a0206a7a-9e2c-49c9-9f53-7dafc5222eed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:32.390051 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a0206a7a-9e2c-49c9-9f53-7dafc5222eed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.655488 Sep 11 08:47:32.391030 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 42/82] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:31 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:32.399489 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:32.403680 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:32.405323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb18f94f-303a-4e95-a19e-f13b8b987f75 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:32.406346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb18f94f-303a-4e95-a19e-f13b8b987f75 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:32.407239 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb18f94f-303a-4e95-a19e-f13b8b987f75 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:32.409505 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb18f94f-303a-4e95-a19e-f13b8b987f75 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:32.409899 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:32.410555 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb18f94f-303a-4e95-a19e-f13b8b987f75 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:32.410719 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:32.411028 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:32.411377 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb18f94f-303a-4e95-a19e-f13b8b987f75 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:32.411806 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:32.412265 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:32.412698 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:32.605266 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:32.616296 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:32.618377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:32.626438 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e9ddc7fb-33af-4286-a2f6-18ad9bbab692 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.227650 Sep 11 08:47:32.626438 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 43/83] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:32 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:32.834671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-fb18f94f-303a-4e95-a19e-f13b8b987f75 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:32.857135 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-fb18f94f-303a-4e95-a19e-f13b8b987f75 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.510113 Sep 11 08:47:32.944629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 41/84] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:32 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:33.391759 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2e16ce55-4e69-4766-8a3e-5f3fa01daebe tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:33.392881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2e16ce55-4e69-4766-8a3e-5f3fa01daebe tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:33.407583 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2e16ce55-4e69-4766-8a3e-5f3fa01daebe tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:33.408635 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2e16ce55-4e69-4766-8a3e-5f3fa01daebe tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:33.409635 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2e16ce55-4e69-4766-8a3e-5f3fa01daebe tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:33.411550 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2e16ce55-4e69-4766-8a3e-5f3fa01daebe tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:33.412685 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2e16ce55-4e69-4766-8a3e-5f3fa01daebe tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:33.413713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2e16ce55-4e69-4766-8a3e-5f3fa01daebe tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:33.439117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b5604a17-e20a-4950-b642-0739779b4c89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:33.440249 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b5604a17-e20a-4950-b642-0739779b4c89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:33.459879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5604a17-e20a-4950-b642-0739779b4c89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:33.461697 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5604a17-e20a-4950-b642-0739779b4c89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:33.463380 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5604a17-e20a-4950-b642-0739779b4c89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:33.464692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5604a17-e20a-4950-b642-0739779b4c89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:33.465467 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5604a17-e20a-4950-b642-0739779b4c89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:33.466257 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5604a17-e20a-4950-b642-0739779b4c89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:33.567776 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2e16ce55-4e69-4766-8a3e-5f3fa01daebe tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:33.594914 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2e16ce55-4e69-4766-8a3e-5f3fa01daebe tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1288 microversion: 2.1 time: 0.208016 Sep 11 08:47:33.596425 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 44/85] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:33 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1288 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:33.659450 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:33.666014 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:33.673061 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:33.674088 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:33.674917 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:33.676514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:33.677356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:33.678130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:33.905139 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b5604a17-e20a-4950-b642-0739779b4c89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:33.927432 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b5604a17-e20a-4950-b642-0739779b4c89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.497380 Sep 11 08:47:33.927432 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 42/86] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:33 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:33.963016 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-413ee16b-bc78-4573-bb1d-d5ae59da0ae6 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:33.964892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-413ee16b-bc78-4573-bb1d-d5ae59da0ae6 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:33.979317 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413ee16b-bc78-4573-bb1d-d5ae59da0ae6 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:33.980542 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413ee16b-bc78-4573-bb1d-d5ae59da0ae6 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:33.981583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413ee16b-bc78-4573-bb1d-d5ae59da0ae6 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:33.983619 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413ee16b-bc78-4573-bb1d-d5ae59da0ae6 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:33.985447 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413ee16b-bc78-4573-bb1d-d5ae59da0ae6 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:33.987486 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413ee16b-bc78-4573-bb1d-d5ae59da0ae6 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:34.093815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:34.105603 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:34.108249 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:34.109698 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f94a707d-bcdf-41c3-90c0-8c7af7a0f616 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.457947 Sep 11 08:47:34.146342 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 45/87] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:33 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:34.529172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-413ee16b-bc78-4573-bb1d-d5ae59da0ae6 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:34.554239 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-413ee16b-bc78-4573-bb1d-d5ae59da0ae6 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.599783 Sep 11 08:47:34.557398 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 43/88] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:33 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:34.636054 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ffc34017-4de9-4a17-9b85-dfec96b8f552 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:34.636884 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ffc34017-4de9-4a17-9b85-dfec96b8f552 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:34.676788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffc34017-4de9-4a17-9b85-dfec96b8f552 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:34.677838 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffc34017-4de9-4a17-9b85-dfec96b8f552 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:34.690561 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffc34017-4de9-4a17-9b85-dfec96b8f552 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:34.697459 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffc34017-4de9-4a17-9b85-dfec96b8f552 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:34.704561 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffc34017-4de9-4a17-9b85-dfec96b8f552 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:34.705790 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffc34017-4de9-4a17-9b85-dfec96b8f552 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:34.976288 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c2721993-b19c-45f8-9c12-cc684f81bbe0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:34.977495 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c2721993-b19c-45f8-9c12-cc684f81bbe0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:34.992602 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:35.005755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c2721993-b19c-45f8-9c12-cc684f81bbe0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:35.011699 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c2721993-b19c-45f8-9c12-cc684f81bbe0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:35.020278 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c2721993-b19c-45f8-9c12-cc684f81bbe0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:35.022012 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c2721993-b19c-45f8-9c12-cc684f81bbe0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:35.023155 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c2721993-b19c-45f8-9c12-cc684f81bbe0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:35.024189 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c2721993-b19c-45f8-9c12-cc684f81bbe0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:35.035778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ffc34017-4de9-4a17-9b85-dfec96b8f552 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:35.060657 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ffc34017-4de9-4a17-9b85-dfec96b8f552 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1306 microversion: 2.1 time: 0.438526 Sep 11 08:47:35.062944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 46/89] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:34 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1306 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:35.143043 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:35.144106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:35.159512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:35.160378 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:35.161012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:35.162176 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:35.163175 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:35.163923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:35.521044 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:35.545928 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:35.549454 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:35.552520 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ece16cff-3a10-495a-a991-655b9fef9915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.414712 Sep 11 08:47:35.554006 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 47/90] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:35 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:35.603269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-11311e7f-4211-4b02-b2eb-ae0496693cbf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:35.604461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-11311e7f-4211-4b02-b2eb-ae0496693cbf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:35.616496 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11311e7f-4211-4b02-b2eb-ae0496693cbf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:35.617400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11311e7f-4211-4b02-b2eb-ae0496693cbf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:35.618216 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11311e7f-4211-4b02-b2eb-ae0496693cbf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:35.619859 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11311e7f-4211-4b02-b2eb-ae0496693cbf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:35.620712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11311e7f-4211-4b02-b2eb-ae0496693cbf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:35.621757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11311e7f-4211-4b02-b2eb-ae0496693cbf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:35.698484 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c2721993-b19c-45f8-9c12-cc684f81bbe0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:35.714496 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c2721993-b19c-45f8-9c12-cc684f81bbe0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.751706 Sep 11 08:47:35.719997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 44/91] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:34 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:35.918985 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-11311e7f-4211-4b02-b2eb-ae0496693cbf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:35.933349 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-11311e7f-4211-4b02-b2eb-ae0496693cbf tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.337433 Sep 11 08:47:35.934020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 48/92] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:35 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:36.104561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3a331c98-c1cf-4881-9004-6948645d1760 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:36.106010 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3a331c98-c1cf-4881-9004-6948645d1760 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:36.114413 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a331c98-c1cf-4881-9004-6948645d1760 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:36.115008 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a331c98-c1cf-4881-9004-6948645d1760 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:36.115522 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a331c98-c1cf-4881-9004-6948645d1760 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:36.117123 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a331c98-c1cf-4881-9004-6948645d1760 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:36.117915 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a331c98-c1cf-4881-9004-6948645d1760 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:36.118638 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a331c98-c1cf-4881-9004-6948645d1760 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:36.245975 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3a331c98-c1cf-4881-9004-6948645d1760 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:36.258302 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3a331c98-c1cf-4881-9004-6948645d1760 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1294 microversion: 2.1 time: 0.158842 Sep 11 08:47:36.258881 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 45/93] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:36 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1294 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:36.595508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:36.597138 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:36.625556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:36.625556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:36.625556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:36.626279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:36.629098 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:36.629098 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:36.751170 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a25b2d16-db0b-48ab-a53e-7a90438538af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:36.752515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a25b2d16-db0b-48ab-a53e-7a90438538af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:36.762668 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a25b2d16-db0b-48ab-a53e-7a90438538af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:36.763693 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a25b2d16-db0b-48ab-a53e-7a90438538af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:36.765575 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a25b2d16-db0b-48ab-a53e-7a90438538af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:36.766771 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a25b2d16-db0b-48ab-a53e-7a90438538af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:36.767937 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a25b2d16-db0b-48ab-a53e-7a90438538af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:36.768648 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a25b2d16-db0b-48ab-a53e-7a90438538af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:36.866525 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:36.888904 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:36.892323 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:36.895490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-cd5a6dc0-8a03-4720-b238-5876e8bdf8e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.308098 Sep 11 08:47:36.896615 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 49/94] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:36 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:36.964646 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-971690d2-2dc6-4fbe-9d91-284753a06f6e tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:36.965942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-971690d2-2dc6-4fbe-9d91-284753a06f6e tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:36.981752 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-971690d2-2dc6-4fbe-9d91-284753a06f6e tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:36.983274 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-971690d2-2dc6-4fbe-9d91-284753a06f6e tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:36.984265 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-971690d2-2dc6-4fbe-9d91-284753a06f6e tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:36.985806 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-971690d2-2dc6-4fbe-9d91-284753a06f6e tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:36.987028 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-971690d2-2dc6-4fbe-9d91-284753a06f6e tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:36.989913 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a25b2d16-db0b-48ab-a53e-7a90438538af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:36.990186 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-971690d2-2dc6-4fbe-9d91-284753a06f6e tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:36.999778 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a25b2d16-db0b-48ab-a53e-7a90438538af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.257345 Sep 11 08:47:37.001151 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 46/95] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:36 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:37.190760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-971690d2-2dc6-4fbe-9d91-284753a06f6e tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:37.201027 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-971690d2-2dc6-4fbe-9d91-284753a06f6e tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.245077 Sep 11 08:47:37.201997 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 50/96] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:36 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:37.287716 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a37ae803-1590-4ec8-8d0b-09c4e3d9a601 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:37.288503 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a37ae803-1590-4ec8-8d0b-09c4e3d9a601 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:37.295761 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a37ae803-1590-4ec8-8d0b-09c4e3d9a601 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:37.296260 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a37ae803-1590-4ec8-8d0b-09c4e3d9a601 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:37.296706 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a37ae803-1590-4ec8-8d0b-09c4e3d9a601 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:37.297428 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a37ae803-1590-4ec8-8d0b-09c4e3d9a601 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:37.297887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a37ae803-1590-4ec8-8d0b-09c4e3d9a601 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:37.298371 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a37ae803-1590-4ec8-8d0b-09c4e3d9a601 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:37.597821 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a37ae803-1590-4ec8-8d0b-09c4e3d9a601 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:37.607293 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a37ae803-1590-4ec8-8d0b-09c4e3d9a601 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.323911 Sep 11 08:47:37.608254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 47/97] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:37 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:37.932609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:37.933443 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:37.936175 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=4 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:37.943133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:37.943823 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:37.944446 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:37.945449 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:37.946045 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:37.947203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:38.041522 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-daf06813-9ec3-4c26-a878-da6d384d05ad tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:38.043570 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-daf06813-9ec3-4c26-a878-da6d384d05ad tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:38.054253 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-daf06813-9ec3-4c26-a878-da6d384d05ad tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:38.055428 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-daf06813-9ec3-4c26-a878-da6d384d05ad tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:38.057086 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-daf06813-9ec3-4c26-a878-da6d384d05ad tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:38.058183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-daf06813-9ec3-4c26-a878-da6d384d05ad tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:38.058992 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-daf06813-9ec3-4c26-a878-da6d384d05ad tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:38.059748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-daf06813-9ec3-4c26-a878-da6d384d05ad tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:38.180012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:38.199258 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:38.204717 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:38.208884 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-42d5628e-adcc-4e1d-bf91-c19f9e32409d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.281549 Sep 11 08:47:38.213271 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 51/98] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:37 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:47:38.235709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-65650195-d57b-4f1b-8761-d95cbad01f80 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:38.236923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-65650195-d57b-4f1b-8761-d95cbad01f80 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:38.249865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65650195-d57b-4f1b-8761-d95cbad01f80 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:38.251725 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65650195-d57b-4f1b-8761-d95cbad01f80 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:38.252854 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65650195-d57b-4f1b-8761-d95cbad01f80 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:38.254960 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65650195-d57b-4f1b-8761-d95cbad01f80 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:38.256236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65650195-d57b-4f1b-8761-d95cbad01f80 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:38.257631 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65650195-d57b-4f1b-8761-d95cbad01f80 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:38.412147 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-daf06813-9ec3-4c26-a878-da6d384d05ad tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:38.422853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-daf06813-9ec3-4c26-a878-da6d384d05ad tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.388606 Sep 11 08:47:38.424133 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 48/99] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:38 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:38.515627 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-65650195-d57b-4f1b-8761-d95cbad01f80 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:38.527422 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-65650195-d57b-4f1b-8761-d95cbad01f80 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.302833 Sep 11 08:47:38.532420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 52/100] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:38 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:38.644574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3657d187-46df-474d-a1c1-140fcf7b83d9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:38.645758 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3657d187-46df-474d-a1c1-140fcf7b83d9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:38.659106 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3657d187-46df-474d-a1c1-140fcf7b83d9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:38.660408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3657d187-46df-474d-a1c1-140fcf7b83d9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:38.661808 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3657d187-46df-474d-a1c1-140fcf7b83d9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:38.663241 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3657d187-46df-474d-a1c1-140fcf7b83d9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:38.664813 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3657d187-46df-474d-a1c1-140fcf7b83d9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:38.666473 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3657d187-46df-474d-a1c1-140fcf7b83d9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:38.864910 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-69061078-6bab-496e-b772-fdea599bb18d req-c7999a9f-6c27-4fb0-88c3-160f7b24edbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1185ff5c-f369-4602-8e3e-c4a1438ed06e", "tag": "90d591de-aca3-45c6-b43c-b9d5b5525d09"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:38.896411 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-69061078-6bab-496e-b772-fdea599bb18d req-c7999a9f-6c27-4fb0-88c3-160f7b24edbd service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:38.897497 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-69061078-6bab-496e-b772-fdea599bb18d req-c7999a9f-6c27-4fb0-88c3-160f7b24edbd service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:38.900551 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-69061078-6bab-496e-b772-fdea599bb18d req-c7999a9f-6c27-4fb0-88c3-160f7b24edbd service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:38.922906 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-69061078-6bab-496e-b772-fdea599bb18d req-c7999a9f-6c27-4fb0-88c3-160f7b24edbd service nova] Creating event network-changed:90d591de-aca3-45c6-b43c-b9d5b5525d09 for instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e on hv-cinder-85694 Sep 11 08:47:38.940423 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-69061078-6bab-496e-b772-fdea599bb18d req-c7999a9f-6c27-4fb0-88c3-160f7b24edbd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081351 Sep 11 08:47:38.940423 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 53/101] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:38.973473 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3657d187-46df-474d-a1c1-140fcf7b83d9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:38.984252 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3657d187-46df-474d-a1c1-140fcf7b83d9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.345835 Sep 11 08:47:38.984995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 49/102] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:38 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:39.281320 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:39.282691 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:39.285419 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=10 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:39.291265 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:39.291788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:39.292300 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:39.293058 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:39.293520 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:39.293950 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:39.453985 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-147189b1-6e8d-4b62-aeb1-5fce95fb1c8d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:39.455191 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-147189b1-6e8d-4b62-aeb1-5fce95fb1c8d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:39.466950 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-147189b1-6e8d-4b62-aeb1-5fce95fb1c8d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:39.467840 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-147189b1-6e8d-4b62-aeb1-5fce95fb1c8d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:39.468639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-147189b1-6e8d-4b62-aeb1-5fce95fb1c8d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:39.470568 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-147189b1-6e8d-4b62-aeb1-5fce95fb1c8d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:39.471383 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-147189b1-6e8d-4b62-aeb1-5fce95fb1c8d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:39.472108 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-147189b1-6e8d-4b62-aeb1-5fce95fb1c8d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:39.507242 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:39.512327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:39.520458 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:39.523295 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:39.525909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3e3d5a74-9d74-4082-bf3e-71fe395771fa tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.254205 Sep 11 08:47:39.526837 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 54/103] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:39 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:39.568077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7616b558-ed4a-405e-ba34-daa8d4107fc7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:39.569369 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7616b558-ed4a-405e-ba34-daa8d4107fc7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:39.580750 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7616b558-ed4a-405e-ba34-daa8d4107fc7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:39.581589 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7616b558-ed4a-405e-ba34-daa8d4107fc7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:39.582439 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7616b558-ed4a-405e-ba34-daa8d4107fc7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:39.584130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7616b558-ed4a-405e-ba34-daa8d4107fc7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:39.585633 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7616b558-ed4a-405e-ba34-daa8d4107fc7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:39.586636 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7616b558-ed4a-405e-ba34-daa8d4107fc7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:39.720437 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-147189b1-6e8d-4b62-aeb1-5fce95fb1c8d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:39.735204 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-147189b1-6e8d-4b62-aeb1-5fce95fb1c8d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.290424 Sep 11 08:47:39.737119 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 50/104] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:39 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:39.858349 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7616b558-ed4a-405e-ba34-daa8d4107fc7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:39.873446 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7616b558-ed4a-405e-ba34-daa8d4107fc7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.311874 Sep 11 08:47:39.898684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 55/105] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:39 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:40.013374 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6c142c46-f865-486a-a943-c7a89a0c1743 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:40.014305 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6c142c46-f865-486a-a943-c7a89a0c1743 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:40.021971 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c142c46-f865-486a-a943-c7a89a0c1743 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:40.022529 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c142c46-f865-486a-a943-c7a89a0c1743 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:40.023080 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c142c46-f865-486a-a943-c7a89a0c1743 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:40.024003 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c142c46-f865-486a-a943-c7a89a0c1743 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:40.024569 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c142c46-f865-486a-a943-c7a89a0c1743 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:40.025056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c142c46-f865-486a-a943-c7a89a0c1743 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:40.211701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6c142c46-f865-486a-a943-c7a89a0c1743 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:40.226448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6c142c46-f865-486a-a943-c7a89a0c1743 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.217873 Sep 11 08:47:40.229089 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 51/106] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:40 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:40.554567 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:40.556811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:40.566099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:40.566799 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:40.567366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:40.568868 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:40.568868 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:40.569259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:40.759809 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:40.768023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-fc0d0ef8-8d74-4acf-967e-f9aa764e8216 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:40.770316 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-fc0d0ef8-8d74-4acf-967e-f9aa764e8216 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:40.776092 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:40.778422 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:40.780007 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-af0c515a-9ddc-43fd-a88b-6979dbf1ac98 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.230477 Sep 11 08:47:40.781187 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 56/107] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:40 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:40.783813 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fc0d0ef8-8d74-4acf-967e-f9aa764e8216 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:40.784593 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fc0d0ef8-8d74-4acf-967e-f9aa764e8216 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:40.785051 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fc0d0ef8-8d74-4acf-967e-f9aa764e8216 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:40.785789 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fc0d0ef8-8d74-4acf-967e-f9aa764e8216 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:40.786289 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fc0d0ef8-8d74-4acf-967e-f9aa764e8216 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:40.786811 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fc0d0ef8-8d74-4acf-967e-f9aa764e8216 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:40.918618 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-07f102f0-43fa-4ba7-a3e6-69a7a54bccc4 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:40.919943 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-07f102f0-43fa-4ba7-a3e6-69a7a54bccc4 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:40.932891 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-07f102f0-43fa-4ba7-a3e6-69a7a54bccc4 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:40.934250 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-07f102f0-43fa-4ba7-a3e6-69a7a54bccc4 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:40.935379 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-07f102f0-43fa-4ba7-a3e6-69a7a54bccc4 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:40.937348 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-07f102f0-43fa-4ba7-a3e6-69a7a54bccc4 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:40.938571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-07f102f0-43fa-4ba7-a3e6-69a7a54bccc4 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:40.939640 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-07f102f0-43fa-4ba7-a3e6-69a7a54bccc4 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:41.174781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-07f102f0-43fa-4ba7-a3e6-69a7a54bccc4 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:41.186872 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-07f102f0-43fa-4ba7-a3e6-69a7a54bccc4 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.274325 Sep 11 08:47:41.188297 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 57/108] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:40 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:41.273935 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3d044dda-1300-4323-a839-fd20ad762a9e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:41.277045 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3d044dda-1300-4323-a839-fd20ad762a9e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:41.295836 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d044dda-1300-4323-a839-fd20ad762a9e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:41.296585 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d044dda-1300-4323-a839-fd20ad762a9e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:41.297603 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d044dda-1300-4323-a839-fd20ad762a9e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:41.298082 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d044dda-1300-4323-a839-fd20ad762a9e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:41.298629 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d044dda-1300-4323-a839-fd20ad762a9e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:41.299069 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d044dda-1300-4323-a839-fd20ad762a9e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:41.455118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3d044dda-1300-4323-a839-fd20ad762a9e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:41.466025 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3d044dda-1300-4323-a839-fd20ad762a9e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.202819 Sep 11 08:47:41.470218 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 58/109] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:41 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:41.549400 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-fc0d0ef8-8d74-4acf-967e-f9aa764e8216 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:41.560716 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-fc0d0ef8-8d74-4acf-967e-f9aa764e8216 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.796677 Sep 11 08:47:41.561888 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 52/110] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:40 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:41.825248 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:41.827223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:41.837836 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:41.838520 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:41.839064 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:41.840212 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:41.840798 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:41.841833 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:42.073376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:42.085131 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:42.087810 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:42.089272 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-329f207a-56f8-424c-b1fe-ad420c6318d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.273945 Sep 11 08:47:42.106743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 59/111] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:41 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:42.224727 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3049763f-d57b-43e9-af01-92dac7cb31fc tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:42.226175 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3049763f-d57b-43e9-af01-92dac7cb31fc tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:42.246947 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3049763f-d57b-43e9-af01-92dac7cb31fc tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:42.246947 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3049763f-d57b-43e9-af01-92dac7cb31fc tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:42.246947 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3049763f-d57b-43e9-af01-92dac7cb31fc tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:42.246947 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3049763f-d57b-43e9-af01-92dac7cb31fc tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:42.247273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3049763f-d57b-43e9-af01-92dac7cb31fc tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:42.247273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3049763f-d57b-43e9-af01-92dac7cb31fc tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:42.495750 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0b358d9a-4341-4d73-8d8a-154d8b6371fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:42.496654 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0b358d9a-4341-4d73-8d8a-154d8b6371fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:42.505963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b358d9a-4341-4d73-8d8a-154d8b6371fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:42.506713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b358d9a-4341-4d73-8d8a-154d8b6371fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:42.508563 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b358d9a-4341-4d73-8d8a-154d8b6371fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:42.510456 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b358d9a-4341-4d73-8d8a-154d8b6371fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:42.511375 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b358d9a-4341-4d73-8d8a-154d8b6371fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:42.511934 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b358d9a-4341-4d73-8d8a-154d8b6371fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:42.534183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3049763f-d57b-43e9-af01-92dac7cb31fc tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:42.549595 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3049763f-d57b-43e9-af01-92dac7cb31fc tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.336230 Sep 11 08:47:42.550243 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 53/112] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:42 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:42.769000 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-c21407d9-02d1-4fc2-83ca-1ceb9590f9cd req-f42584a9-58e3-48cd-a4d6-b80ed2266c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ab3837-2058-4f46-8361-2535358fced8", "name": "network-vif-plugged", "status": "completed", "tag": "a4e1aef8-2ebd-4142-9d16-5aae187c8a59"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:42.797439 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-c21407d9-02d1-4fc2-83ca-1ceb9590f9cd req-f42584a9-58e3-48cd-a4d6-b80ed2266c58 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:42.798286 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-c21407d9-02d1-4fc2-83ca-1ceb9590f9cd req-f42584a9-58e3-48cd-a4d6-b80ed2266c58 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:42.799155 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-c21407d9-02d1-4fc2-83ca-1ceb9590f9cd req-f42584a9-58e3-48cd-a4d6-b80ed2266c58 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:42.822858 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-c21407d9-02d1-4fc2-83ca-1ceb9590f9cd req-f42584a9-58e3-48cd-a4d6-b80ed2266c58 service nova] Creating event network-vif-plugged:a4e1aef8-2ebd-4142-9d16-5aae187c8a59 for instance 18ab3837-2058-4f46-8361-2535358fced8 on hv-cinder-85694 Sep 11 08:47:42.830983 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-c21407d9-02d1-4fc2-83ca-1ceb9590f9cd req-f42584a9-58e3-48cd-a4d6-b80ed2266c58 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241336 Sep 11 08:47:42.832078 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 54/113] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:42.839764 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-21832101-6a79-44fa-9399-d95cb8518530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:42.840730 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-21832101-6a79-44fa-9399-d95cb8518530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:42.849909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21832101-6a79-44fa-9399-d95cb8518530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:42.856376 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21832101-6a79-44fa-9399-d95cb8518530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:42.856376 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21832101-6a79-44fa-9399-d95cb8518530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:42.856705 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0b358d9a-4341-4d73-8d8a-154d8b6371fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:42.857655 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21832101-6a79-44fa-9399-d95cb8518530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:42.857655 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21832101-6a79-44fa-9399-d95cb8518530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:42.857655 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21832101-6a79-44fa-9399-d95cb8518530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:42.868412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0b358d9a-4341-4d73-8d8a-154d8b6371fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.378280 Sep 11 08:47:42.869025 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 60/114] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:42 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:43.078392 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-21832101-6a79-44fa-9399-d95cb8518530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:43.089151 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-21832101-6a79-44fa-9399-d95cb8518530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.255550 Sep 11 08:47:43.089919 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 55/115] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:42 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:43.119702 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:43.120490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:43.129568 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:43.130300 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:43.130942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:43.132343 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:43.132936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:43.133459 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:43.326762 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:43.339424 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:43.342249 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:43.344273 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d400c9b3-4f3b-4756-9e04-c62da4f09333 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.230172 Sep 11 08:47:43.345112 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 61/116] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:43 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:47:43.580513 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6ebb8df7-5d43-4b95-80d0-dde55c0f1e5d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:43.581374 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6ebb8df7-5d43-4b95-80d0-dde55c0f1e5d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:43.588482 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ebb8df7-5d43-4b95-80d0-dde55c0f1e5d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:43.589334 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ebb8df7-5d43-4b95-80d0-dde55c0f1e5d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:43.589954 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ebb8df7-5d43-4b95-80d0-dde55c0f1e5d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:43.590854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ebb8df7-5d43-4b95-80d0-dde55c0f1e5d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:43.591481 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ebb8df7-5d43-4b95-80d0-dde55c0f1e5d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:43.592037 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ebb8df7-5d43-4b95-80d0-dde55c0f1e5d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:43.925000 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-aa81ba45-ca68-4677-8f7b-b459df21ebe4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:43.926443 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-aa81ba45-ca68-4677-8f7b-b459df21ebe4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:43.938874 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aa81ba45-ca68-4677-8f7b-b459df21ebe4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:43.940109 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aa81ba45-ca68-4677-8f7b-b459df21ebe4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:43.940894 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aa81ba45-ca68-4677-8f7b-b459df21ebe4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:43.942213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aa81ba45-ca68-4677-8f7b-b459df21ebe4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:43.943559 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aa81ba45-ca68-4677-8f7b-b459df21ebe4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:43.944574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aa81ba45-ca68-4677-8f7b-b459df21ebe4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:43.969274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6ebb8df7-5d43-4b95-80d0-dde55c0f1e5d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:43.983171 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6ebb8df7-5d43-4b95-80d0-dde55c0f1e5d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.407342 Sep 11 08:47:43.984936 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 56/117] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:43 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:44.121291 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3246e11f-d41d-4b9e-a816-3f4ec9f5ea92 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:44.122254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3246e11f-d41d-4b9e-a816-3f4ec9f5ea92 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:44.132140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3246e11f-d41d-4b9e-a816-3f4ec9f5ea92 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:44.132832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3246e11f-d41d-4b9e-a816-3f4ec9f5ea92 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:44.133375 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3246e11f-d41d-4b9e-a816-3f4ec9f5ea92 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:44.134333 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3246e11f-d41d-4b9e-a816-3f4ec9f5ea92 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:44.134868 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3246e11f-d41d-4b9e-a816-3f4ec9f5ea92 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:44.135364 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3246e11f-d41d-4b9e-a816-3f4ec9f5ea92 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:44.157436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=100 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:44.245879 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-aa81ba45-ca68-4677-8f7b-b459df21ebe4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:44.258736 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-aa81ba45-ca68-4677-8f7b-b459df21ebe4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.341074 Sep 11 08:47:44.264114 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 62/118] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:43 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:44.313276 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3246e11f-d41d-4b9e-a816-3f4ec9f5ea92 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:44.324746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3246e11f-d41d-4b9e-a816-3f4ec9f5ea92 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.207731 Sep 11 08:47:44.325805 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 57/119] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:44 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:44.373193 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:44.374368 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:44.390926 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:44.390926 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:44.390926 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:44.394874 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:44.397077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:44.398925 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:44.569283 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:44.605069 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:44.605069 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:44.605069 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-85f6ff19-83f6-47c9-a887-b0be6834319b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.236079 Sep 11 08:47:44.605405 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 63/120] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:44 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:44.975112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-0808871d-3d81-4cc5-912c-e341f9fb4a30 req-a89fc0b5-416d-49a9-ac0a-f665326c4425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76ea279-a179-4979-aa4f-e7cde772d1ee", "name": "network-vif-plugged", "status": "completed", "tag": "d7f6207c-9831-44fb-9769-1349bbe6e4a7"}, {"server_uuid": "223e4b7b-8a6c-4647-aa91-aae73dbeb340", "name": "network-vif-plugged", "status": "completed", "tag": "a3c9ee62-2858-49c8-b169-41636e1c8bdd"}, {"server_uuid": "9bbdc2f9-9111-44ca-b51e-5af1c6069184", "name": "network-vif-plugged", "status": "completed", "tag": "ac147de6-ab9b-409f-8399-16076fabf055"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:45.001162 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-0808871d-3d81-4cc5-912c-e341f9fb4a30 req-a89fc0b5-416d-49a9-ac0a-f665326c4425 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:45.002364 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-0808871d-3d81-4cc5-912c-e341f9fb4a30 req-a89fc0b5-416d-49a9-ac0a-f665326c4425 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:45.003411 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-0808871d-3d81-4cc5-912c-e341f9fb4a30 req-a89fc0b5-416d-49a9-ac0a-f665326c4425 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:45.034543 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-0808871d-3d81-4cc5-912c-e341f9fb4a30 req-a89fc0b5-416d-49a9-ac0a-f665326c4425 service nova] Creating event network-vif-plugged:d7f6207c-9831-44fb-9769-1349bbe6e4a7 for instance c76ea279-a179-4979-aa4f-e7cde772d1ee on hv-cinder-85694 Sep 11 08:47:45.035471 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-0808871d-3d81-4cc5-912c-e341f9fb4a30 req-a89fc0b5-416d-49a9-ac0a-f665326c4425 service nova] Creating event network-vif-plugged:a3c9ee62-2858-49c8-b169-41636e1c8bdd for instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 on hv-cinder-85694 Sep 11 08:47:45.036123 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-0808871d-3d81-4cc5-912c-e341f9fb4a30 req-a89fc0b5-416d-49a9-ac0a-f665326c4425 service nova] Creating event network-vif-plugged:ac147de6-ab9b-409f-8399-16076fabf055 for instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 on hv-cinder-85694 Sep 11 08:47:45.039420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b794fb3b-b557-4493-8efa-14190d4e3b3f tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:45.042734 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b794fb3b-b557-4493-8efa-14190d4e3b3f tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:45.046815 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-0808871d-3d81-4cc5-912c-e341f9fb4a30 req-a89fc0b5-416d-49a9-ac0a-f665326c4425 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.080710 Sep 11 08:47:45.047448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 58/121] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:45.060980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b794fb3b-b557-4493-8efa-14190d4e3b3f tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:45.062457 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b794fb3b-b557-4493-8efa-14190d4e3b3f tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:45.063324 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b794fb3b-b557-4493-8efa-14190d4e3b3f tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:45.064620 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b794fb3b-b557-4493-8efa-14190d4e3b3f tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:45.065662 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b794fb3b-b557-4493-8efa-14190d4e3b3f tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:45.066694 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b794fb3b-b557-4493-8efa-14190d4e3b3f tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:45.305698 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8b9b6f1c-bbc9-452e-814f-778ba54e85b8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:45.307455 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8b9b6f1c-bbc9-452e-814f-778ba54e85b8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:45.317907 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8b9b6f1c-bbc9-452e-814f-778ba54e85b8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:45.319431 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8b9b6f1c-bbc9-452e-814f-778ba54e85b8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:45.320546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8b9b6f1c-bbc9-452e-814f-778ba54e85b8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:45.324793 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8b9b6f1c-bbc9-452e-814f-778ba54e85b8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:45.329836 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8b9b6f1c-bbc9-452e-814f-778ba54e85b8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:45.329836 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8b9b6f1c-bbc9-452e-814f-778ba54e85b8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:45.347168 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b794fb3b-b557-4493-8efa-14190d4e3b3f tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:45.367081 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b794fb3b-b557-4493-8efa-14190d4e3b3f tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.347899 Sep 11 08:47:45.378306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 64/122] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:45 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:45.393800 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5709c5ad-21a7-412d-8087-21a4987608ce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:45.395393 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5709c5ad-21a7-412d-8087-21a4987608ce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:45.429274 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5709c5ad-21a7-412d-8087-21a4987608ce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:45.430171 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5709c5ad-21a7-412d-8087-21a4987608ce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:45.431415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5709c5ad-21a7-412d-8087-21a4987608ce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:45.432410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5709c5ad-21a7-412d-8087-21a4987608ce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:45.433345 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5709c5ad-21a7-412d-8087-21a4987608ce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:45.433944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5709c5ad-21a7-412d-8087-21a4987608ce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:45.780154 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5709c5ad-21a7-412d-8087-21a4987608ce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:45.791453 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5709c5ad-21a7-412d-8087-21a4987608ce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1319 microversion: 2.1 time: 0.411356 Sep 11 08:47:45.792155 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 65/123] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:45 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:45.800168 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:45.800952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:45.815561 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:45.816476 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:45.817332 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:45.818603 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:45.819606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:45.820511 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:45.822139 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8b9b6f1c-bbc9-452e-814f-778ba54e85b8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:45.856217 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8b9b6f1c-bbc9-452e-814f-778ba54e85b8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.553621 Sep 11 08:47:45.875344 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 59/124] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:45 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:46.174281 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:46.183931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:46.185765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:46.187350 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2962ac1d-282e-4d2a-b4cb-bd65631acab1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.393123 Sep 11 08:47:46.188051 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 66/125] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:45 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:46.402944 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9b3590a5-aa5b-4e9a-be1c-d048f9bc2fb8 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:46.404027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9b3590a5-aa5b-4e9a-be1c-d048f9bc2fb8 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:46.418312 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b3590a5-aa5b-4e9a-be1c-d048f9bc2fb8 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:46.419135 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b3590a5-aa5b-4e9a-be1c-d048f9bc2fb8 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:46.420126 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b3590a5-aa5b-4e9a-be1c-d048f9bc2fb8 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:46.421343 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b3590a5-aa5b-4e9a-be1c-d048f9bc2fb8 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:46.423092 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b3590a5-aa5b-4e9a-be1c-d048f9bc2fb8 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:46.423863 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b3590a5-aa5b-4e9a-be1c-d048f9bc2fb8 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:46.699033 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-9b3590a5-aa5b-4e9a-be1c-d048f9bc2fb8 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:46.718054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9b3590a5-aa5b-4e9a-be1c-d048f9bc2fb8 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.324369 Sep 11 08:47:46.722071 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 60/126] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:46 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:46.818946 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-bdaae9f8-1d44-42e6-be08-db24bfd4c678 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:46.819843 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-bdaae9f8-1d44-42e6-be08-db24bfd4c678 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:46.828537 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdaae9f8-1d44-42e6-be08-db24bfd4c678 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:46.829043 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdaae9f8-1d44-42e6-be08-db24bfd4c678 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:46.829488 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdaae9f8-1d44-42e6-be08-db24bfd4c678 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:46.830268 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdaae9f8-1d44-42e6-be08-db24bfd4c678 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:46.830735 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdaae9f8-1d44-42e6-be08-db24bfd4c678 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:46.831339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdaae9f8-1d44-42e6-be08-db24bfd4c678 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:46.887726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9b9ddb32-9c2c-48f9-a5a4-d84da5427eb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:46.888618 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9b9ddb32-9c2c-48f9-a5a4-d84da5427eb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:46.892634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=78 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:46.896600 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b9ddb32-9c2c-48f9-a5a4-d84da5427eb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:46.897108 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b9ddb32-9c2c-48f9-a5a4-d84da5427eb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:46.897752 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b9ddb32-9c2c-48f9-a5a4-d84da5427eb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:46.898509 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b9ddb32-9c2c-48f9-a5a4-d84da5427eb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:46.898979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b9ddb32-9c2c-48f9-a5a4-d84da5427eb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:46.902679 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9b9ddb32-9c2c-48f9-a5a4-d84da5427eb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:47.041805 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-bdaae9f8-1d44-42e6-be08-db24bfd4c678 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:47.057687 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-bdaae9f8-1d44-42e6-be08-db24bfd4c678 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1512 microversion: 2.1 time: 0.243803 Sep 11 08:47:47.058855 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 67/127] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:46 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:47.109234 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-88cf04bd-e2ec-473a-8776-d459366a219d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:47.109626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-88cf04bd-e2ec-473a-8776-d459366a219d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:47.121541 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-88cf04bd-e2ec-473a-8776-d459366a219d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:47.122843 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-88cf04bd-e2ec-473a-8776-d459366a219d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:47.123604 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-88cf04bd-e2ec-473a-8776-d459366a219d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:47.125240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-88cf04bd-e2ec-473a-8776-d459366a219d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:47.125505 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-9b9ddb32-9c2c-48f9-a5a4-d84da5427eb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:47.126297 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-88cf04bd-e2ec-473a-8776-d459366a219d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:47.127115 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-88cf04bd-e2ec-473a-8776-d459366a219d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:47.143947 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9b9ddb32-9c2c-48f9-a5a4-d84da5427eb9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.261583 Sep 11 08:47:47.145417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 61/128] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:46 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:47.262848 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:47.262848 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:47.262848 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:47.262848 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:47.264448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:47.264448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:47.264448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:47.264448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:47.264944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-88cf04bd-e2ec-473a-8776-d459366a219d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lazy-loading 'flavor' on Instance uuid 18ab3837-2058-4f46-8361-2535358fced8 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:47:47.586244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:47.617456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:47.625286 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:47.626641 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e6a92c5a-8b54-4aef-bf5a-68dfc040f538 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.397447 Sep 11 08:47:47.627799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 62/129] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:47 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:47.700025 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-88cf04bd-e2ec-473a-8776-d459366a219d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "POST /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8/action" status: 200 len: 32 microversion: 2.1 time: 0.600603 Sep 11 08:47:47.702753 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 68/130] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:47:47 2022] POST /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8/action => generated 32 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 08:47:47.718490 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0942a771-b2f4-4310-a1bf-ca71307f4db5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:47.720719 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0942a771-b2f4-4310-a1bf-ca71307f4db5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:47.732629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0942a771-b2f4-4310-a1bf-ca71307f4db5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:47.733452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0942a771-b2f4-4310-a1bf-ca71307f4db5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:47.734285 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0942a771-b2f4-4310-a1bf-ca71307f4db5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:47.735657 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0942a771-b2f4-4310-a1bf-ca71307f4db5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:47.736382 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0942a771-b2f4-4310-a1bf-ca71307f4db5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:47.737058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0942a771-b2f4-4310-a1bf-ca71307f4db5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:47.766654 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3683bcaa-6e38-4488-8a0c-c6e6cccefa01 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:47.768382 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3683bcaa-6e38-4488-8a0c-c6e6cccefa01 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:47.791750 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3683bcaa-6e38-4488-8a0c-c6e6cccefa01 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:47.797681 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3683bcaa-6e38-4488-8a0c-c6e6cccefa01 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:47.798728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3683bcaa-6e38-4488-8a0c-c6e6cccefa01 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:47.800520 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3683bcaa-6e38-4488-8a0c-c6e6cccefa01 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:47.801688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3683bcaa-6e38-4488-8a0c-c6e6cccefa01 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:47.802781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3683bcaa-6e38-4488-8a0c-c6e6cccefa01 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:47.838521 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:48.068177 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0942a771-b2f4-4310-a1bf-ca71307f4db5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:48.088368 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0942a771-b2f4-4310-a1bf-ca71307f4db5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.375618 Sep 11 08:47:48.089795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 63/131] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:47 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:48.099072 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-54b2bedb-96d3-47bf-af69-20daf9e5e319 req-b0ecc8ff-08ea-4a7a-9c34-73c9ac961197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1185ff5c-f369-4602-8e3e-c4a1438ed06e", "name": "network-vif-plugged", "status": "completed", "tag": "90d591de-aca3-45c6-b43c-b9d5b5525d09"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:48.118639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-54b2bedb-96d3-47bf-af69-20daf9e5e319 req-b0ecc8ff-08ea-4a7a-9c34-73c9ac961197 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:48.120016 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-54b2bedb-96d3-47bf-af69-20daf9e5e319 req-b0ecc8ff-08ea-4a7a-9c34-73c9ac961197 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:48.121157 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-54b2bedb-96d3-47bf-af69-20daf9e5e319 req-b0ecc8ff-08ea-4a7a-9c34-73c9ac961197 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:48.132485 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3683bcaa-6e38-4488-8a0c-c6e6cccefa01 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:48.150676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-54b2bedb-96d3-47bf-af69-20daf9e5e319 req-b0ecc8ff-08ea-4a7a-9c34-73c9ac961197 service nova] Creating event network-vif-plugged:90d591de-aca3-45c6-b43c-b9d5b5525d09 for instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e on hv-cinder-85694 Sep 11 08:47:48.150985 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3683bcaa-6e38-4488-8a0c-c6e6cccefa01 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.392951 Sep 11 08:47:48.151860 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 69/132] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:47 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:48.170519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-54b2bedb-96d3-47bf-af69-20daf9e5e319 req-b0ecc8ff-08ea-4a7a-9c34-73c9ac961197 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077987 Sep 11 08:47:48.172220 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 64/133] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:48.178860 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-42867eec-213c-4ae8-8857-fcfede20a95d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:48.179519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-42867eec-213c-4ae8-8857-fcfede20a95d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:48.187936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42867eec-213c-4ae8-8857-fcfede20a95d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:48.188678 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42867eec-213c-4ae8-8857-fcfede20a95d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:48.189391 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42867eec-213c-4ae8-8857-fcfede20a95d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:48.191054 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42867eec-213c-4ae8-8857-fcfede20a95d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:48.191771 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42867eec-213c-4ae8-8857-fcfede20a95d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:48.192550 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42867eec-213c-4ae8-8857-fcfede20a95d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:48.456959 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-42867eec-213c-4ae8-8857-fcfede20a95d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:48.479240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-42867eec-213c-4ae8-8857-fcfede20a95d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.307163 Sep 11 08:47:48.481388 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 70/134] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:48 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:48.700133 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:48.701401 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:48.723823 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:48.728049 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:48.729651 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:48.736252 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:48.738053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:48.738920 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:49.007332 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:49.034299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:49.037557 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:49.040524 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e2a1f946-899c-460b-9340-937e72f2d6fe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.374968 Sep 11 08:47:49.050881 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 65/135] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:48 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:49.123554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4f4205a0-ec1c-4cfb-aa6b-e5203e08ca81 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:49.125149 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4f4205a0-ec1c-4cfb-aa6b-e5203e08ca81 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:49.129118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:49.140201 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4f4205a0-ec1c-4cfb-aa6b-e5203e08ca81 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:49.141439 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4f4205a0-ec1c-4cfb-aa6b-e5203e08ca81 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:49.142604 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4f4205a0-ec1c-4cfb-aa6b-e5203e08ca81 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:49.144879 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4f4205a0-ec1c-4cfb-aa6b-e5203e08ca81 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:49.146446 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4f4205a0-ec1c-4cfb-aa6b-e5203e08ca81 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:49.147497 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4f4205a0-ec1c-4cfb-aa6b-e5203e08ca81 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:49.183223 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-06342661-8924-474e-95e6-883e68bcf29a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:49.189428 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-06342661-8924-474e-95e6-883e68bcf29a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:49.198779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-06342661-8924-474e-95e6-883e68bcf29a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:49.199455 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-06342661-8924-474e-95e6-883e68bcf29a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:49.200184 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-06342661-8924-474e-95e6-883e68bcf29a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:49.201236 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-06342661-8924-474e-95e6-883e68bcf29a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:49.202017 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-06342661-8924-474e-95e6-883e68bcf29a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:49.202604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-06342661-8924-474e-95e6-883e68bcf29a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:49.438135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4f4205a0-ec1c-4cfb-aa6b-e5203e08ca81 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:49.445021 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-06342661-8924-474e-95e6-883e68bcf29a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:49.451470 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4f4205a0-ec1c-4cfb-aa6b-e5203e08ca81 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.338185 Sep 11 08:47:49.452412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 71/136] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:49 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:49.458081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-06342661-8924-474e-95e6-883e68bcf29a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.281756 Sep 11 08:47:49.472504 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 66/137] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:49 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:49.525068 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ea3fcdf4-f8a7-47db-8c8e-36f013558e2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:49.526297 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ea3fcdf4-f8a7-47db-8c8e-36f013558e2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:49.552411 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea3fcdf4-f8a7-47db-8c8e-36f013558e2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:49.553369 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea3fcdf4-f8a7-47db-8c8e-36f013558e2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:49.560555 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea3fcdf4-f8a7-47db-8c8e-36f013558e2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:49.560555 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea3fcdf4-f8a7-47db-8c8e-36f013558e2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:49.563765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea3fcdf4-f8a7-47db-8c8e-36f013558e2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:49.568602 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea3fcdf4-f8a7-47db-8c8e-36f013558e2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:49.829659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ea3fcdf4-f8a7-47db-8c8e-36f013558e2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:49.843613 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ea3fcdf4-f8a7-47db-8c8e-36f013558e2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.327813 Sep 11 08:47:49.844726 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 72/138] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:49 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:50.092033 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:50.092909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:50.110879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:50.111573 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:50.112254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:50.113272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:50.113738 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:50.114359 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:50.278951 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:50.288880 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:50.290920 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:50.292065 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-79bd2bca-e9f7-4ca9-9012-2159c6d745f2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.206600 Sep 11 08:47:50.292635 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 67/139] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:50 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:50.492168 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2ade4fe2-b36d-49d6-9610-944257000539 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:50.492823 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2ade4fe2-b36d-49d6-9610-944257000539 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:50.500117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-aab8e4bb-fb1b-4f81-b226-d50ced393284 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:50.500117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-aab8e4bb-fb1b-4f81-b226-d50ced393284 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:50.505743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ade4fe2-b36d-49d6-9610-944257000539 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:50.506669 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ade4fe2-b36d-49d6-9610-944257000539 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:50.507569 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ade4fe2-b36d-49d6-9610-944257000539 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:50.510456 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ade4fe2-b36d-49d6-9610-944257000539 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:50.511661 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ade4fe2-b36d-49d6-9610-944257000539 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:50.512380 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aab8e4bb-fb1b-4f81-b226-d50ced393284 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:50.513337 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aab8e4bb-fb1b-4f81-b226-d50ced393284 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:50.514360 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aab8e4bb-fb1b-4f81-b226-d50ced393284 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:50.515742 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aab8e4bb-fb1b-4f81-b226-d50ced393284 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:50.516704 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aab8e4bb-fb1b-4f81-b226-d50ced393284 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:50.517810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aab8e4bb-fb1b-4f81-b226-d50ced393284 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:50.526489 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ade4fe2-b36d-49d6-9610-944257000539 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:50.785658 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-aab8e4bb-fb1b-4f81-b226-d50ced393284 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:50.797383 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-aab8e4bb-fb1b-4f81-b226-d50ced393284 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.308673 Sep 11 08:47:50.797972 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 68/140] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:50 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:50.877039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2ade4fe2-b36d-49d6-9610-944257000539 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:50.897126 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2ade4fe2-b36d-49d6-9610-944257000539 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1313 microversion: 2.1 time: 0.414547 Sep 11 08:47:50.909923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 73/141] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:50 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:50.917021 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8a3e3e9e-fa21-4339-aafd-01e58d942360 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:50.917944 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8a3e3e9e-fa21-4339-aafd-01e58d942360 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:50.925262 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a3e3e9e-fa21-4339-aafd-01e58d942360 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:50.925811 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a3e3e9e-fa21-4339-aafd-01e58d942360 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:50.926306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a3e3e9e-fa21-4339-aafd-01e58d942360 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:50.927615 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a3e3e9e-fa21-4339-aafd-01e58d942360 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:50.927615 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a3e3e9e-fa21-4339-aafd-01e58d942360 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:50.928372 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a3e3e9e-fa21-4339-aafd-01e58d942360 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:51.130748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8a3e3e9e-fa21-4339-aafd-01e58d942360 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:51.150961 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8a3e3e9e-fa21-4339-aafd-01e58d942360 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.264118 Sep 11 08:47:51.152095 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 69/142] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:50 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:51.326275 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:51.327436 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:51.339448 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:51.340347 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:51.341347 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:51.342889 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:51.343657 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:51.344374 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:51.656290 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:51.665906 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:51.667358 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:51.669207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c9c77227-fcc3-4b60-b675-fd4f95eb5b8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1406 microversion: 2.20 time: 0.351158 Sep 11 08:47:51.669964 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 74/143] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:51 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:47:51.832246 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-84a4d250-1a88-4d82-a5aa-5a856b6dd99c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:51.832864 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-84a4d250-1a88-4d82-a5aa-5a856b6dd99c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:51.840118 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a4d250-1a88-4d82-a5aa-5a856b6dd99c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:51.840783 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a4d250-1a88-4d82-a5aa-5a856b6dd99c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:51.841300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a4d250-1a88-4d82-a5aa-5a856b6dd99c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:51.842082 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a4d250-1a88-4d82-a5aa-5a856b6dd99c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:51.842634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a4d250-1a88-4d82-a5aa-5a856b6dd99c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:51.843056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a4d250-1a88-4d82-a5aa-5a856b6dd99c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:51.923993 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-22067f87-cc7a-456a-9bf3-27b52770a992 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:51.929117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-22067f87-cc7a-456a-9bf3-27b52770a992 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:51.931558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-22067f87-cc7a-456a-9bf3-27b52770a992 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:51.932046 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-22067f87-cc7a-456a-9bf3-27b52770a992 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:51.932477 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-22067f87-cc7a-456a-9bf3-27b52770a992 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:51.933305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-22067f87-cc7a-456a-9bf3-27b52770a992 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:51.933766 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-22067f87-cc7a-456a-9bf3-27b52770a992 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:51.934204 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-22067f87-cc7a-456a-9bf3-27b52770a992 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:52.081796 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-84a4d250-1a88-4d82-a5aa-5a856b6dd99c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:52.091228 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-84a4d250-1a88-4d82-a5aa-5a856b6dd99c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.263000 Sep 11 08:47:52.091821 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 70/144] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:51 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:52.152356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-22067f87-cc7a-456a-9bf3-27b52770a992 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:52.164836 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-22067f87-cc7a-456a-9bf3-27b52770a992 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1500 microversion: 2.1 time: 0.243929 Sep 11 08:47:52.164836 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 75/145] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:51 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1500 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:52.189078 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-dec3a8f9-ebfb-425d-adda-2ffac5547322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:52.189928 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-dec3a8f9-ebfb-425d-adda-2ffac5547322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:52.201345 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dec3a8f9-ebfb-425d-adda-2ffac5547322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:52.202104 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dec3a8f9-ebfb-425d-adda-2ffac5547322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:52.202749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dec3a8f9-ebfb-425d-adda-2ffac5547322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:52.203603 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dec3a8f9-ebfb-425d-adda-2ffac5547322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:52.204179 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dec3a8f9-ebfb-425d-adda-2ffac5547322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:52.204803 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dec3a8f9-ebfb-425d-adda-2ffac5547322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:52.442067 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-dec3a8f9-ebfb-425d-adda-2ffac5547322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:52.450767 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-dec3a8f9-ebfb-425d-adda-2ffac5547322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1359 microversion: 2.1 time: 0.267790 Sep 11 08:47:52.451675 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 71/146] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:52 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1359 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:52.699307 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:52.704270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:52.722020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:52.722591 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:52.723044 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:52.723769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:52.724490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:52.724772 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:53.026445 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:53.039190 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:53.041500 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:53.043210 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-51deaeab-07c5-48c2-8803-c330b0cedf73 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1598 microversion: 2.20 time: 0.351313 Sep 11 08:47:53.044158 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 76/147] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:47:52 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1598 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:47:53.091563 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-42a68ffd-44dc-4ae5-af88-2762cd625915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:53.092369 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-42a68ffd-44dc-4ae5-af88-2762cd625915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:53.120623 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5a04e015-7eee-46d0-8c8a-a9ea938b240d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:53.122389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5a04e015-7eee-46d0-8c8a-a9ea938b240d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:53.129662 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-42a68ffd-44dc-4ae5-af88-2762cd625915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:53.135258 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-42a68ffd-44dc-4ae5-af88-2762cd625915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:53.136265 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-42a68ffd-44dc-4ae5-af88-2762cd625915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:53.144023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-42a68ffd-44dc-4ae5-af88-2762cd625915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:53.144209 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-42a68ffd-44dc-4ae5-af88-2762cd625915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:53.148290 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-42a68ffd-44dc-4ae5-af88-2762cd625915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:53.149541 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a04e015-7eee-46d0-8c8a-a9ea938b240d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:53.174330 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a04e015-7eee-46d0-8c8a-a9ea938b240d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:53.175305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a04e015-7eee-46d0-8c8a-a9ea938b240d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:53.176535 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a04e015-7eee-46d0-8c8a-a9ea938b240d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:53.177304 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a04e015-7eee-46d0-8c8a-a9ea938b240d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:53.178026 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a04e015-7eee-46d0-8c8a-a9ea938b240d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:53.412589 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-42a68ffd-44dc-4ae5-af88-2762cd625915 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.328625 Sep 11 08:47:53.414117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 72/148] 10.222.0.44 () {60 vars in 1316 bytes} [Sun Sep 11 08:47:53 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-interface => generated 284 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:47:53.489140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-09b0dbbb-7f1b-48c7-92e0-ef87efe12db7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:53.489966 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-09b0dbbb-7f1b-48c7-92e0-ef87efe12db7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:53.505118 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09b0dbbb-7f1b-48c7-92e0-ef87efe12db7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:53.505611 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09b0dbbb-7f1b-48c7-92e0-ef87efe12db7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:53.506519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09b0dbbb-7f1b-48c7-92e0-ef87efe12db7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:53.507168 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09b0dbbb-7f1b-48c7-92e0-ef87efe12db7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:53.507903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09b0dbbb-7f1b-48c7-92e0-ef87efe12db7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:53.508947 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09b0dbbb-7f1b-48c7-92e0-ef87efe12db7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:53.828150 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-09b0dbbb-7f1b-48c7-92e0-ef87efe12db7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:53.838020 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-09b0dbbb-7f1b-48c7-92e0-ef87efe12db7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1544 microversion: 2.1 time: 0.353056 Sep 11 08:47:53.839212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 73/149] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:53 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1544 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:47:53.894409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f3ddcee9-cb47-4ec7-9a20-0740ab269b06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:53.894905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f3ddcee9-cb47-4ec7-9a20-0740ab269b06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:53.903157 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3ddcee9-cb47-4ec7-9a20-0740ab269b06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:53.904006 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3ddcee9-cb47-4ec7-9a20-0740ab269b06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:53.904725 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3ddcee9-cb47-4ec7-9a20-0740ab269b06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:53.905605 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3ddcee9-cb47-4ec7-9a20-0740ab269b06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:53.907408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3ddcee9-cb47-4ec7-9a20-0740ab269b06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:53.908028 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3ddcee9-cb47-4ec7-9a20-0740ab269b06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:54.019736 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5a04e015-7eee-46d0-8c8a-a9ea938b240d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:54.061632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f3ddcee9-cb47-4ec7-9a20-0740ab269b06 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159942 Sep 11 08:47:54.061632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 74/150] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 08:47:53 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:54.062359 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5a04e015-7eee-46d0-8c8a-a9ea938b240d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.947604 Sep 11 08:47:54.070356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 77/151] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:53 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:54.350122 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c8041c7e-4bf3-472b-bed8-1448463e8136 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea470967-efb4-4ecc-aa0f-9dfb3f55e946"}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:54.355677 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c8041c7e-4bf3-472b-bed8-1448463e8136 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:54.376105 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8041c7e-4bf3-472b-bed8-1448463e8136 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:54.377222 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8041c7e-4bf3-472b-bed8-1448463e8136 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:54.378829 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8041c7e-4bf3-472b-bed8-1448463e8136 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:54.380267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8041c7e-4bf3-472b-bed8-1448463e8136 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:54.381179 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8041c7e-4bf3-472b-bed8-1448463e8136 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:54.382553 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8041c7e-4bf3-472b-bed8-1448463e8136 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:54.803297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=100 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:47:55.116944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-76569828-e722-4eff-8a6c-caf867166b07 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:55.118632 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-76569828-e722-4eff-8a6c-caf867166b07 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:55.130405 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-76569828-e722-4eff-8a6c-caf867166b07 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:55.131512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-76569828-e722-4eff-8a6c-caf867166b07 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:55.132586 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-76569828-e722-4eff-8a6c-caf867166b07 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:55.135034 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-76569828-e722-4eff-8a6c-caf867166b07 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:55.136084 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-76569828-e722-4eff-8a6c-caf867166b07 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:55.136951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-76569828-e722-4eff-8a6c-caf867166b07 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:55.640755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-76569828-e722-4eff-8a6c-caf867166b07 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:55.676479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-76569828-e722-4eff-8a6c-caf867166b07 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.562150 Sep 11 08:47:55.689980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 78/152] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:55 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:55.840795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c8041c7e-4bf3-472b-bed8-1448463e8136 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "POST /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.498837 Sep 11 08:47:55.842674 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 75/153] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:47:54 2022] POST /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee/os-volume_attachments => generated 194 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:56.547435 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-d90c6a67-786b-4a3b-8be1-a21c9f4e4c58 req-07e6c3cb-df30-45ec-a6f5-9175454e39c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223e4b7b-8a6c-4647-aa91-aae73dbeb340", "tag": "a3c9ee62-2858-49c8-b169-41636e1c8bdd"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:56.564898 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d90c6a67-786b-4a3b-8be1-a21c9f4e4c58 req-07e6c3cb-df30-45ec-a6f5-9175454e39c8 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:56.567600 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d90c6a67-786b-4a3b-8be1-a21c9f4e4c58 req-07e6c3cb-df30-45ec-a6f5-9175454e39c8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:56.568512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d90c6a67-786b-4a3b-8be1-a21c9f4e4c58 req-07e6c3cb-df30-45ec-a6f5-9175454e39c8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:56.594041 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-d90c6a67-786b-4a3b-8be1-a21c9f4e4c58 req-07e6c3cb-df30-45ec-a6f5-9175454e39c8 service nova] Creating event network-changed:a3c9ee62-2858-49c8-b169-41636e1c8bdd for instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 on hv-cinder-85694 Sep 11 08:47:56.602923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-d90c6a67-786b-4a3b-8be1-a21c9f4e4c58 req-07e6c3cb-df30-45ec-a6f5-9175454e39c8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059707 Sep 11 08:47:56.605033 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 79/154] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:56.708234 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8719ed53-e9c0-4a94-9608-3e127487b44e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:56.709055 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8719ed53-e9c0-4a94-9608-3e127487b44e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:56.719945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8719ed53-e9c0-4a94-9608-3e127487b44e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:56.723134 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8719ed53-e9c0-4a94-9608-3e127487b44e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:56.723830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8719ed53-e9c0-4a94-9608-3e127487b44e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:56.724938 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8719ed53-e9c0-4a94-9608-3e127487b44e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:56.725638 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8719ed53-e9c0-4a94-9608-3e127487b44e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:56.726199 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8719ed53-e9c0-4a94-9608-3e127487b44e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:57.405185 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-8f46dffd-3810-4eb6-ad2e-1621df5e37f4 req-d706a504-408a-434b-8ccf-d558fae500dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1185ff5c-f369-4602-8e3e-c4a1438ed06e", "tag": "90d591de-aca3-45c6-b43c-b9d5b5525d09"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:47:57.423303 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8719ed53-e9c0-4a94-9608-3e127487b44e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:57.434780 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8719ed53-e9c0-4a94-9608-3e127487b44e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.731329 Sep 11 08:47:57.439389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-8f46dffd-3810-4eb6-ad2e-1621df5e37f4 req-d706a504-408a-434b-8ccf-d558fae500dc service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:57.440978 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-8f46dffd-3810-4eb6-ad2e-1621df5e37f4 req-d706a504-408a-434b-8ccf-d558fae500dc service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:57.442089 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-8f46dffd-3810-4eb6-ad2e-1621df5e37f4 req-d706a504-408a-434b-8ccf-d558fae500dc service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:57.465881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-8f46dffd-3810-4eb6-ad2e-1621df5e37f4 req-d706a504-408a-434b-8ccf-d558fae500dc service nova] Creating event network-changed:90d591de-aca3-45c6-b43c-b9d5b5525d09 for instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e on hv-cinder-85694 Sep 11 08:47:57.467891 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 76/155] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:56 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:57.473210 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-8f46dffd-3810-4eb6-ad2e-1621df5e37f4 req-d706a504-408a-434b-8ccf-d558fae500dc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076566 Sep 11 08:47:57.479208 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 80/156] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:47:58.467577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0d32a1e8-8e88-4ce9-b0d1-e08614709a5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:58.468274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0d32a1e8-8e88-4ce9-b0d1-e08614709a5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:58.476399 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0d32a1e8-8e88-4ce9-b0d1-e08614709a5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:58.478126 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0d32a1e8-8e88-4ce9-b0d1-e08614709a5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:58.485324 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0d32a1e8-8e88-4ce9-b0d1-e08614709a5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:58.487842 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0d32a1e8-8e88-4ce9-b0d1-e08614709a5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:58.490515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0d32a1e8-8e88-4ce9-b0d1-e08614709a5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:58.492911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0d32a1e8-8e88-4ce9-b0d1-e08614709a5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:58.785084 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0d32a1e8-8e88-4ce9-b0d1-e08614709a5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:47:58.799841 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0d32a1e8-8e88-4ce9-b0d1-e08614709a5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.336653 Sep 11 08:47:58.800951 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 77/157] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:58 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:47:59.829612 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9a1dbc6a-4f3d-404b-b711-543607b226f6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:47:59.831022 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9a1dbc6a-4f3d-404b-b711-543607b226f6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:47:59.838436 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a1dbc6a-4f3d-404b-b711-543607b226f6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:59.840220 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a1dbc6a-4f3d-404b-b711-543607b226f6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:59.840927 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a1dbc6a-4f3d-404b-b711-543607b226f6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:47:59.841809 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a1dbc6a-4f3d-404b-b711-543607b226f6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:47:59.842587 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a1dbc6a-4f3d-404b-b711-543607b226f6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:47:59.843118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a1dbc6a-4f3d-404b-b711-543607b226f6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:00.297985 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9a1dbc6a-4f3d-404b-b711-543607b226f6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:00.321409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9a1dbc6a-4f3d-404b-b711-543607b226f6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.498287 Sep 11 08:48:00.338759 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 81/158] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:47:59 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:01.365324 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d5f58410-bc8e-47e3-9281-39e59319b813 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:01.366529 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d5f58410-bc8e-47e3-9281-39e59319b813 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:01.378648 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f58410-bc8e-47e3-9281-39e59319b813 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:01.379496 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f58410-bc8e-47e3-9281-39e59319b813 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:01.380268 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f58410-bc8e-47e3-9281-39e59319b813 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:01.381831 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f58410-bc8e-47e3-9281-39e59319b813 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:01.382593 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f58410-bc8e-47e3-9281-39e59319b813 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:01.384339 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f58410-bc8e-47e3-9281-39e59319b813 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:01.626871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d5f58410-bc8e-47e3-9281-39e59319b813 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:01.636306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d5f58410-bc8e-47e3-9281-39e59319b813 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.275139 Sep 11 08:48:01.637005 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 78/159] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:01 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:02.661445 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-27af9a7d-3e5d-4e11-9a44-ac445079882e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:02.662077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-27af9a7d-3e5d-4e11-9a44-ac445079882e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:02.668261 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27af9a7d-3e5d-4e11-9a44-ac445079882e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:02.668870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27af9a7d-3e5d-4e11-9a44-ac445079882e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:02.669225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27af9a7d-3e5d-4e11-9a44-ac445079882e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:02.669921 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27af9a7d-3e5d-4e11-9a44-ac445079882e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:02.670429 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27af9a7d-3e5d-4e11-9a44-ac445079882e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:02.670852 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27af9a7d-3e5d-4e11-9a44-ac445079882e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:02.921404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-27af9a7d-3e5d-4e11-9a44-ac445079882e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:02.934451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-27af9a7d-3e5d-4e11-9a44-ac445079882e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.276810 Sep 11 08:48:02.936295 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 82/160] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:02 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:03.962093 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6635e594-0f92-4cbb-8099-d4f9fda0299d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:03.962730 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6635e594-0f92-4cbb-8099-d4f9fda0299d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:03.968753 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6635e594-0f92-4cbb-8099-d4f9fda0299d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:03.969246 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6635e594-0f92-4cbb-8099-d4f9fda0299d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:03.969755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6635e594-0f92-4cbb-8099-d4f9fda0299d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:03.970472 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6635e594-0f92-4cbb-8099-d4f9fda0299d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:03.970939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6635e594-0f92-4cbb-8099-d4f9fda0299d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:03.971362 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6635e594-0f92-4cbb-8099-d4f9fda0299d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:04.406103 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6635e594-0f92-4cbb-8099-d4f9fda0299d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:04.424685 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6635e594-0f92-4cbb-8099-d4f9fda0299d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.467656 Sep 11 08:48:04.425677 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 79/161] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:03 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:05.452358 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-79b6be70-02d8-49a1-afb3-8053a28b72a4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:05.453717 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-79b6be70-02d8-49a1-afb3-8053a28b72a4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:05.460708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-79b6be70-02d8-49a1-afb3-8053a28b72a4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:05.462648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-79b6be70-02d8-49a1-afb3-8053a28b72a4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:05.464302 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-79b6be70-02d8-49a1-afb3-8053a28b72a4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:05.465290 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-79b6be70-02d8-49a1-afb3-8053a28b72a4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:05.465764 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-79b6be70-02d8-49a1-afb3-8053a28b72a4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:05.466261 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-79b6be70-02d8-49a1-afb3-8053a28b72a4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:05.629314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-79b6be70-02d8-49a1-afb3-8053a28b72a4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:05.643411 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-79b6be70-02d8-49a1-afb3-8053a28b72a4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.198696 Sep 11 08:48:05.649881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 83/162] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:05 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:06.676634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-cd0e5035-1556-4605-a671-d893dc10745f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:06.678812 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-cd0e5035-1556-4605-a671-d893dc10745f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:06.695654 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cd0e5035-1556-4605-a671-d893dc10745f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:06.696108 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cd0e5035-1556-4605-a671-d893dc10745f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:06.697077 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cd0e5035-1556-4605-a671-d893dc10745f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:06.698507 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cd0e5035-1556-4605-a671-d893dc10745f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:06.698753 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cd0e5035-1556-4605-a671-d893dc10745f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:06.699238 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cd0e5035-1556-4605-a671-d893dc10745f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:06.937133 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-cd0e5035-1556-4605-a671-d893dc10745f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:06.948253 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-cd0e5035-1556-4605-a671-d893dc10745f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.279157 Sep 11 08:48:06.949119 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 80/163] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:06 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:07.536140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1674126446", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "networks": [{"uuid": "dc8de692-111e-4945-9712-7a5420c305ac"}]}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:07.617764 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] validate_networks() for [('dc8de692-111e-4945-9712-7a5420c305ac', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:48:07.979561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-08bb3f84-c186-4b42-b671-c7d1ab740a89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:07.983177 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-08bb3f84-c186-4b42-b671-c7d1ab740a89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:08.005700 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bb3f84-c186-4b42-b671-c7d1ab740a89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:08.006204 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bb3f84-c186-4b42-b671-c7d1ab740a89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:08.006646 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bb3f84-c186-4b42-b671-c7d1ab740a89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:08.007384 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bb3f84-c186-4b42-b671-c7d1ab740a89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:08.008593 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bb3f84-c186-4b42-b671-c7d1ab740a89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:08.009019 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bb3f84-c186-4b42-b671-c7d1ab740a89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:08.156240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:48:08.156784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:48:08.157328 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:48:08.157919 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:48:08.158460 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:48:08.172714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:08.174338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:08.176244 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:08.177659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:08.178572 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:08.179474 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:08.203508 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-08bb3f84-c186-4b42-b671-c7d1ab740a89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:08.213522 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-08bb3f84-c186-4b42-b671-c7d1ab740a89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.243465 Sep 11 08:48:08.215536 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 81/164] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:07 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:08.228853 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Getting quotas for project ead98e6e89d840a0b99273f28429b4ba. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:48:08.233936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Getting quotas for user 0b198ff6ed104068b38b993054617f9a and project ead98e6e89d840a0b99273f28429b4ba. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:48:08.256173 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:48:08.258578 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:48:08.431179 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-14c6967a-051c-4e5f-9e23-9d73600f5652 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898799 Sep 11 08:48:08.444033 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 84/165] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:48:08.459143 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1543c7c7-9ce8-41cd-a0d2-40415ba01fb8 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:08.460270 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1543c7c7-9ce8-41cd-a0d2-40415ba01fb8 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:08.606534 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1543c7c7-9ce8-41cd-a0d2-40415ba01fb8 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:08.626513 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1543c7c7-9ce8-41cd-a0d2-40415ba01fb8 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1214 microversion: 2.1 time: 0.173876 Sep 11 08:48:08.629507 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 82/166] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:08 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1214 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:09.266347 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1bfed5b9-5ff7-4455-83a1-79c7ee7cd55b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:09.266963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1bfed5b9-5ff7-4455-83a1-79c7ee7cd55b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:09.279879 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bfed5b9-5ff7-4455-83a1-79c7ee7cd55b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:09.280807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bfed5b9-5ff7-4455-83a1-79c7ee7cd55b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:09.282213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bfed5b9-5ff7-4455-83a1-79c7ee7cd55b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:09.283734 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bfed5b9-5ff7-4455-83a1-79c7ee7cd55b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:09.284903 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bfed5b9-5ff7-4455-83a1-79c7ee7cd55b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:09.285502 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bfed5b9-5ff7-4455-83a1-79c7ee7cd55b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:09.286738 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-99c5381f-9f11-469f-a251-c33d9f06dfac tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:09.287763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-99c5381f-9f11-469f-a251-c33d9f06dfac tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:09.295047 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99c5381f-9f11-469f-a251-c33d9f06dfac tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:09.295892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99c5381f-9f11-469f-a251-c33d9f06dfac tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:09.296337 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99c5381f-9f11-469f-a251-c33d9f06dfac tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:09.297356 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99c5381f-9f11-469f-a251-c33d9f06dfac tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:09.297879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99c5381f-9f11-469f-a251-c33d9f06dfac tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:09.298566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99c5381f-9f11-469f-a251-c33d9f06dfac tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:09.327516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-99c5381f-9f11-469f-a251-c33d9f06dfac tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:48:09.511067 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1bfed5b9-5ff7-4455-83a1-79c7ee7cd55b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:09.521997 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1bfed5b9-5ff7-4455-83a1-79c7ee7cd55b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.259796 Sep 11 08:48:09.522761 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 85/167] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:09 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:09.674846 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-198c8870-8b99-4c4c-b953-f6f5283f2984 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:09.678242 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-198c8870-8b99-4c4c-b953-f6f5283f2984 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:09.749817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-198c8870-8b99-4c4c-b953-f6f5283f2984 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:09.757381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-198c8870-8b99-4c4c-b953-f6f5283f2984 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1214 microversion: 2.1 time: 0.091178 Sep 11 08:48:09.757995 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 86/168] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:09 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:09.797836 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-99c5381f-9f11-469f-a251-c33d9f06dfac tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 204 len: 0 microversion: 2.1 time: 0.514317 Sep 11 08:48:09.799586 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 83/169] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:48:09 2022] DELETE /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:48:09.810140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-480c4605-eaef-4632-8276-9f9660361859 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:09.810786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-480c4605-eaef-4632-8276-9f9660361859 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:09.816932 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480c4605-eaef-4632-8276-9f9660361859 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:09.817484 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480c4605-eaef-4632-8276-9f9660361859 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:09.817929 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480c4605-eaef-4632-8276-9f9660361859 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:09.818679 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480c4605-eaef-4632-8276-9f9660361859 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:09.819147 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480c4605-eaef-4632-8276-9f9660361859 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:09.819733 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480c4605-eaef-4632-8276-9f9660361859 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:10.018950 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-480c4605-eaef-4632-8276-9f9660361859 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:10.028519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-480c4605-eaef-4632-8276-9f9660361859 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1552 microversion: 2.1 time: 0.222175 Sep 11 08:48:10.029563 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 87/170] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:09 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1552 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:10.566485 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3dfa615a-3ca2-4b73-b8ec-a4a8ec154036 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:10.567375 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3dfa615a-3ca2-4b73-b8ec-a4a8ec154036 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:10.577725 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3dfa615a-3ca2-4b73-b8ec-a4a8ec154036 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:10.577725 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3dfa615a-3ca2-4b73-b8ec-a4a8ec154036 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:10.577725 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3dfa615a-3ca2-4b73-b8ec-a4a8ec154036 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:10.578178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3dfa615a-3ca2-4b73-b8ec-a4a8ec154036 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:10.578461 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3dfa615a-3ca2-4b73-b8ec-a4a8ec154036 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:10.578857 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3dfa615a-3ca2-4b73-b8ec-a4a8ec154036 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:10.771770 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3dfa615a-3ca2-4b73-b8ec-a4a8ec154036 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:10.785092 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-65f3027b-a497-4294-b610-f37bc39bab90 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:10.788613 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-65f3027b-a497-4294-b610-f37bc39bab90 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:10.790324 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3dfa615a-3ca2-4b73-b8ec-a4a8ec154036 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.227183 Sep 11 08:48:10.806192 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 84/171] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:10 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:10.807142 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65f3027b-a497-4294-b610-f37bc39bab90 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:10.807142 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65f3027b-a497-4294-b610-f37bc39bab90 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:10.807142 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65f3027b-a497-4294-b610-f37bc39bab90 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:10.807142 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65f3027b-a497-4294-b610-f37bc39bab90 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:10.807693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65f3027b-a497-4294-b610-f37bc39bab90 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:10.807693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-65f3027b-a497-4294-b610-f37bc39bab90 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:10.901593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-65f3027b-a497-4294-b610-f37bc39bab90 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:10.914661 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-65f3027b-a497-4294-b610-f37bc39bab90 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1218 microversion: 2.1 time: 0.136704 Sep 11 08:48:10.918462 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 88/172] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:10 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:11.066765 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-363f9f53-411e-4999-8ef6-46a62f4f220c tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:11.067861 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-363f9f53-411e-4999-8ef6-46a62f4f220c tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:11.079614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-363f9f53-411e-4999-8ef6-46a62f4f220c tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:11.080934 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-363f9f53-411e-4999-8ef6-46a62f4f220c tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:11.081695 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-363f9f53-411e-4999-8ef6-46a62f4f220c tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:11.083024 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-363f9f53-411e-4999-8ef6-46a62f4f220c tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:11.083834 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-363f9f53-411e-4999-8ef6-46a62f4f220c tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:11.084596 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-363f9f53-411e-4999-8ef6-46a62f4f220c tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:11.331638 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-363f9f53-411e-4999-8ef6-46a62f4f220c tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:11.349279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-363f9f53-411e-4999-8ef6-46a62f4f220c tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1552 microversion: 2.1 time: 0.289783 Sep 11 08:48:11.350385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 85/173] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:11 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1552 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:11.827022 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8443d1dd-f48b-4f27-9994-b902a94b082b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:11.828455 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8443d1dd-f48b-4f27-9994-b902a94b082b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:11.840715 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8443d1dd-f48b-4f27-9994-b902a94b082b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:11.842445 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8443d1dd-f48b-4f27-9994-b902a94b082b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:11.843405 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8443d1dd-f48b-4f27-9994-b902a94b082b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:11.844936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8443d1dd-f48b-4f27-9994-b902a94b082b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:11.847099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8443d1dd-f48b-4f27-9994-b902a94b082b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:11.848865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8443d1dd-f48b-4f27-9994-b902a94b082b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:11.860444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:11.949763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b44dcc67-067d-4a29-a250-42d6238e93bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:11.950921 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b44dcc67-067d-4a29-a250-42d6238e93bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:11.963012 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b44dcc67-067d-4a29-a250-42d6238e93bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:11.963829 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b44dcc67-067d-4a29-a250-42d6238e93bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:11.964537 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b44dcc67-067d-4a29-a250-42d6238e93bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:11.965913 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b44dcc67-067d-4a29-a250-42d6238e93bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:11.971516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b44dcc67-067d-4a29-a250-42d6238e93bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:11.972560 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b44dcc67-067d-4a29-a250-42d6238e93bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:12.105477 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8443d1dd-f48b-4f27-9994-b902a94b082b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:12.119721 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8443d1dd-f48b-4f27-9994-b902a94b082b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.300898 Sep 11 08:48:12.121627 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 89/174] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:11 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:12.140000 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b44dcc67-067d-4a29-a250-42d6238e93bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:12.156865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b44dcc67-067d-4a29-a250-42d6238e93bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1218 microversion: 2.1 time: 0.211919 Sep 11 08:48:12.158629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 86/175] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:11 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:12.377428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ffd0ba45-bc91-4823-b0af-9174790516a2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:12.378648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ffd0ba45-bc91-4823-b0af-9174790516a2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:12.387519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffd0ba45-bc91-4823-b0af-9174790516a2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:12.388287 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffd0ba45-bc91-4823-b0af-9174790516a2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:12.388893 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffd0ba45-bc91-4823-b0af-9174790516a2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:12.389881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffd0ba45-bc91-4823-b0af-9174790516a2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:12.390536 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffd0ba45-bc91-4823-b0af-9174790516a2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:12.391635 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ffd0ba45-bc91-4823-b0af-9174790516a2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:12.728677 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ffd0ba45-bc91-4823-b0af-9174790516a2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:12.769192 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ffd0ba45-bc91-4823-b0af-9174790516a2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1552 microversion: 2.1 time: 0.397104 Sep 11 08:48:12.770833 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 90/176] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:12 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1552 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:13.149847 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-31af9a66-2e81-42d9-a6b0-1ce475159c8f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:13.151879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-31af9a66-2e81-42d9-a6b0-1ce475159c8f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:13.171731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31af9a66-2e81-42d9-a6b0-1ce475159c8f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:13.172779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31af9a66-2e81-42d9-a6b0-1ce475159c8f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:13.173568 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31af9a66-2e81-42d9-a6b0-1ce475159c8f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:13.174948 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31af9a66-2e81-42d9-a6b0-1ce475159c8f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:13.176003 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31af9a66-2e81-42d9-a6b0-1ce475159c8f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:13.176665 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31af9a66-2e81-42d9-a6b0-1ce475159c8f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:13.202187 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-73fee0ab-4447-4d7b-97aa-da3d14573f88 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:13.204318 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-73fee0ab-4447-4d7b-97aa-da3d14573f88 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:13.213815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-73fee0ab-4447-4d7b-97aa-da3d14573f88 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:13.215075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-73fee0ab-4447-4d7b-97aa-da3d14573f88 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:13.215713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-73fee0ab-4447-4d7b-97aa-da3d14573f88 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:13.216670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-73fee0ab-4447-4d7b-97aa-da3d14573f88 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:13.217303 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-73fee0ab-4447-4d7b-97aa-da3d14573f88 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:13.217729 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-73fee0ab-4447-4d7b-97aa-da3d14573f88 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:13.398669 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-73fee0ab-4447-4d7b-97aa-da3d14573f88 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:13.413342 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-73fee0ab-4447-4d7b-97aa-da3d14573f88 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1266 microversion: 2.1 time: 0.217175 Sep 11 08:48:13.415122 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 91/177] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:13 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:13.511519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-31af9a66-2e81-42d9-a6b0-1ce475159c8f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:13.564245 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-31af9a66-2e81-42d9-a6b0-1ce475159c8f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.407466 Sep 11 08:48:13.564939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 87/178] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:13 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:13.619323 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-0f1346d9-2796-40b6-8287-b22571381f0e req-7b2e025c-e785-4ed9-ba59-32997cc58c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76ea279-a179-4979-aa4f-e7cde772d1ee", "name": "network-vif-deleted", "tag": "d7f6207c-9831-44fb-9769-1349bbe6e4a7"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:13.643343 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-0f1346d9-2796-40b6-8287-b22571381f0e req-7b2e025c-e785-4ed9-ba59-32997cc58c0c service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:13.644471 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-0f1346d9-2796-40b6-8287-b22571381f0e req-7b2e025c-e785-4ed9-ba59-32997cc58c0c service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:13.645016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-0f1346d9-2796-40b6-8287-b22571381f0e req-7b2e025c-e785-4ed9-ba59-32997cc58c0c service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:13.669277 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-0f1346d9-2796-40b6-8287-b22571381f0e req-7b2e025c-e785-4ed9-ba59-32997cc58c0c service nova] Creating event network-vif-deleted:d7f6207c-9831-44fb-9769-1349bbe6e4a7 for instance c76ea279-a179-4979-aa4f-e7cde772d1ee on hv-cinder-85694 Sep 11 08:48:13.679257 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-0f1346d9-2796-40b6-8287-b22571381f0e req-7b2e025c-e785-4ed9-ba59-32997cc58c0c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073396 Sep 11 08:48:13.680373 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 92/179] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:48:13.807412 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-926be3a7-7bd5-4e11-80cb-85a1ae946c99 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:13.808536 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-926be3a7-7bd5-4e11-80cb-85a1ae946c99 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:13.820640 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-926be3a7-7bd5-4e11-80cb-85a1ae946c99 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:13.821645 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-926be3a7-7bd5-4e11-80cb-85a1ae946c99 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:13.822450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-926be3a7-7bd5-4e11-80cb-85a1ae946c99 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:13.823682 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-926be3a7-7bd5-4e11-80cb-85a1ae946c99 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:13.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-926be3a7-7bd5-4e11-80cb-85a1ae946c99 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:13.826350 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-926be3a7-7bd5-4e11-80cb-85a1ae946c99 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:13.939761 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-926be3a7-7bd5-4e11-80cb-85a1ae946c99 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:13.951990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-926be3a7-7bd5-4e11-80cb-85a1ae946c99 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1344 microversion: 2.1 time: 0.151946 Sep 11 08:48:13.953318 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 88/180] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:13 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1344 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:14.460999 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a0ffde24-71db-4fa4-99ea-9517dd86fa2a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:14.463235 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a0ffde24-71db-4fa4-99ea-9517dd86fa2a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:14.487234 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0ffde24-71db-4fa4-99ea-9517dd86fa2a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:14.492056 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0ffde24-71db-4fa4-99ea-9517dd86fa2a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:14.493548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0ffde24-71db-4fa4-99ea-9517dd86fa2a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:14.495227 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0ffde24-71db-4fa4-99ea-9517dd86fa2a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:14.498936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0ffde24-71db-4fa4-99ea-9517dd86fa2a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:14.501312 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0ffde24-71db-4fa4-99ea-9517dd86fa2a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:14.605117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e0d0b759-3c96-4c9f-b44c-98d9143909d9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:14.605889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e0d0b759-3c96-4c9f-b44c-98d9143909d9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:14.613084 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0b759-3c96-4c9f-b44c-98d9143909d9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:14.613924 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0b759-3c96-4c9f-b44c-98d9143909d9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:14.614794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0b759-3c96-4c9f-b44c-98d9143909d9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:14.615867 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0b759-3c96-4c9f-b44c-98d9143909d9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:14.616897 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0b759-3c96-4c9f-b44c-98d9143909d9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:14.617968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0b759-3c96-4c9f-b44c-98d9143909d9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:14.673857 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a0ffde24-71db-4fa4-99ea-9517dd86fa2a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:14.688365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a0ffde24-71db-4fa4-99ea-9517dd86fa2a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1272 microversion: 2.1 time: 0.234967 Sep 11 08:48:14.689728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 93/181] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:14 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:14.821460 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e0d0b759-3c96-4c9f-b44c-98d9143909d9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:14.830002 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e0d0b759-3c96-4c9f-b44c-98d9143909d9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.228925 Sep 11 08:48:14.830619 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 89/182] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:14 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:14.975876 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:14.976638 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:14.984591 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:14.984893 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:14.985549 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:14.986338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:14.986918 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:14.987503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:15.026470 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:15.026920 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:15.027532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:15.027979 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lazy-loading 'fault' on Instance uuid c76ea279-a179-4979-aa4f-e7cde772d1ee {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:48:15.354111 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:15.364695 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4dc0481b-e1f4-40fd-9bf8-ccf155ed77d2 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1349 microversion: 2.1 time: 0.392859 Sep 11 08:48:15.365393 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 94/183] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:14 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1349 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:15.729352 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b4ff3f3d-b153-482a-9ba5-98d8a0d72c5c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:15.730127 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b4ff3f3d-b153-482a-9ba5-98d8a0d72c5c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:15.737168 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b4ff3f3d-b153-482a-9ba5-98d8a0d72c5c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:15.738703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b4ff3f3d-b153-482a-9ba5-98d8a0d72c5c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:15.738703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b4ff3f3d-b153-482a-9ba5-98d8a0d72c5c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:15.739004 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b4ff3f3d-b153-482a-9ba5-98d8a0d72c5c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:15.739666 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b4ff3f3d-b153-482a-9ba5-98d8a0d72c5c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:15.740092 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b4ff3f3d-b153-482a-9ba5-98d8a0d72c5c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:15.860487 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-08590194-d95a-46e0-946d-0dc828cd922d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:15.865186 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-08590194-d95a-46e0-946d-0dc828cd922d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:15.880516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08590194-d95a-46e0-946d-0dc828cd922d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:15.881323 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08590194-d95a-46e0-946d-0dc828cd922d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:15.881529 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08590194-d95a-46e0-946d-0dc828cd922d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:15.883189 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08590194-d95a-46e0-946d-0dc828cd922d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:15.885015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08590194-d95a-46e0-946d-0dc828cd922d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:15.886981 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08590194-d95a-46e0-946d-0dc828cd922d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:15.941971 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b4ff3f3d-b153-482a-9ba5-98d8a0d72c5c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:15.945649 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:15.953091 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b4ff3f3d-b153-482a-9ba5-98d8a0d72c5c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.228174 Sep 11 08:48:15.953794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 90/184] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:15 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:16.056483 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-08590194-d95a-46e0-946d-0dc828cd922d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:16.069039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-08590194-d95a-46e0-946d-0dc828cd922d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.217909 Sep 11 08:48:16.070165 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 95/185] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:15 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:16.400103 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:16.400792 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:16.407946 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:16.408438 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:16.409079 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:16.410020 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:16.410586 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:16.411014 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:16.456707 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:16.457325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:16.457847 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:16.458422 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lazy-loading 'fault' on Instance uuid c76ea279-a179-4979-aa4f-e7cde772d1ee {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:48:16.513753 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:16.524769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-48b0e4c0-def6-476c-a39e-94254a581e83 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1349 microversion: 2.1 time: 0.136980 Sep 11 08:48:16.525372 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 91/186] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:16 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1349 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:16.977647 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4c276cbf-0bf1-429a-bd25-2e4991625abf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:16.978335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4c276cbf-0bf1-429a-bd25-2e4991625abf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:16.991809 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c276cbf-0bf1-429a-bd25-2e4991625abf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:16.994648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c276cbf-0bf1-429a-bd25-2e4991625abf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:16.995128 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c276cbf-0bf1-429a-bd25-2e4991625abf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:16.995840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c276cbf-0bf1-429a-bd25-2e4991625abf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:16.996295 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c276cbf-0bf1-429a-bd25-2e4991625abf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:16.996748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c276cbf-0bf1-429a-bd25-2e4991625abf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:17.099982 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-da636211-a3f0-418d-8915-4275c1092e7d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:17.101954 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-da636211-a3f0-418d-8915-4275c1092e7d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:17.112365 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da636211-a3f0-418d-8915-4275c1092e7d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:17.113194 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da636211-a3f0-418d-8915-4275c1092e7d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:17.113731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da636211-a3f0-418d-8915-4275c1092e7d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:17.114920 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da636211-a3f0-418d-8915-4275c1092e7d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:17.115460 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da636211-a3f0-418d-8915-4275c1092e7d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:17.115930 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da636211-a3f0-418d-8915-4275c1092e7d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:17.134086 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4c276cbf-0bf1-429a-bd25-2e4991625abf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:17.142063 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4c276cbf-0bf1-429a-bd25-2e4991625abf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.168412 Sep 11 08:48:17.142681 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 96/187] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:16 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:17.271009 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-da636211-a3f0-418d-8915-4275c1092e7d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:17.280950 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-da636211-a3f0-418d-8915-4275c1092e7d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.187829 Sep 11 08:48:17.281570 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 92/188] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:17 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:17.580012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:17.581609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:17.595643 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:17.596962 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:17.598097 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:17.601873 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:17.603159 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:17.604384 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:17.684793 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:17.686086 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:17.687133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:17.688390 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lazy-loading 'fault' on Instance uuid c76ea279-a179-4979-aa4f-e7cde772d1ee {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:48:17.854961 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00407384465c41848ad28a15729a95d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df041c538da419d8576d746b392c4db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:17.880430 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-357c1cfe-c3d9-40dd-9c36-4ffdb954f37a tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 200 len: 1349 microversion: 2.1 time: 0.303293 Sep 11 08:48:17.881583 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 97/189] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:17 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 1349 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:18.172381 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c5d89301-33a0-4e7f-84ff-e1634ada6e7b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:18.173939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c5d89301-33a0-4e7f-84ff-e1634ada6e7b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:18.207169 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:18.234853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c5d89301-33a0-4e7f-84ff-e1634ada6e7b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:18.237355 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c5d89301-33a0-4e7f-84ff-e1634ada6e7b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:18.240896 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c5d89301-33a0-4e7f-84ff-e1634ada6e7b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:18.258456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c5d89301-33a0-4e7f-84ff-e1634ada6e7b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:18.259201 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c5d89301-33a0-4e7f-84ff-e1634ada6e7b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:18.261748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c5d89301-33a0-4e7f-84ff-e1634ada6e7b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:18.309239 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-55452bff-0cab-4acd-bccb-896540d0af5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:18.311401 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-55452bff-0cab-4acd-bccb-896540d0af5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:18.321453 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:18.327158 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-55452bff-0cab-4acd-bccb-896540d0af5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:18.328038 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-55452bff-0cab-4acd-bccb-896540d0af5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:18.328703 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-55452bff-0cab-4acd-bccb-896540d0af5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:18.331281 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-55452bff-0cab-4acd-bccb-896540d0af5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:18.332375 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-55452bff-0cab-4acd-bccb-896540d0af5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:18.333935 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-55452bff-0cab-4acd-bccb-896540d0af5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:18.625732 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:18.633384 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c5d89301-33a0-4e7f-84ff-e1634ada6e7b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:18.642970 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c5d89301-33a0-4e7f-84ff-e1634ada6e7b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.476516 Sep 11 08:48:18.644645 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-55452bff-0cab-4acd-bccb-896540d0af5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:18.654470 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 93/190] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:18 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:18.673358 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-55452bff-0cab-4acd-bccb-896540d0af5d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.370625 Sep 11 08:48:18.675231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 98/191] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:18 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:18.908172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:18.911653 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:18.927592 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:18.929272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:18.930027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:18.930970 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:18.931933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:18.932563 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:18.963444 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] HTTP exception thrown: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Request method failure captured: Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee HTTP/1.1 Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaB4dNfC7RFqPORuJhZ7LUwkP-z5A0QJf55A9aAfXuN6Yja15SjgoPyH2EAAzOUO93_d81bhsxzZP8yeqevKGl7G8hUR-ELEvAK0C6BodqgX_nyiMSA93hq8HhV1pcrTB6r4QPLqGsa75oggnWpZiYadntwYQivByCrs5z7f4EuumaM Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 7df041c538da419d8576d746b392c4db Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:48:18.979535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7df041c538da419d8576d746b392c4db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7df041c538da419d8576d746b392c4db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7df041c538da419d8576d746b392c4db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7df041c538da419d8576d746b392c4db", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 7df041c538da419d8576d746b392c4db Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-DeleteServersTestJSON-758084065-project Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 00407384465c41848ad28a15729a95d6 Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-DeleteServersTestJSON-758084065-project Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:18.981878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'c76ea279-a179-4979-aa4f-e7cde772d1ee'} Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:48:18.983159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:18.985845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:18.988545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Returning 404 to user: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:48:18.988545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d28f3ff1-e7a2-466b-b5ff-2b4556a82a84 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 404 len: 111 microversion: 2.1 time: 0.076975 Sep 11 08:48:18.988545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 94/192] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:18 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:48:19.008635 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-d9d1f88d-71bc-4fb4-af44-86959fbd5a9f req-769db48a-e686-478d-a6d9-c6856c1e0a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fe2eda9-45e2-4ce1-b1e3-313957f3d04a", "tag": "b80323e3-bd2f-48b9-82a7-28c8dd1a9084"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:19.020861 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d9d1f88d-71bc-4fb4-af44-86959fbd5a9f req-769db48a-e686-478d-a6d9-c6856c1e0a9e service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:19.021810 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d9d1f88d-71bc-4fb4-af44-86959fbd5a9f req-769db48a-e686-478d-a6d9-c6856c1e0a9e service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:19.022589 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d9d1f88d-71bc-4fb4-af44-86959fbd5a9f req-769db48a-e686-478d-a6d9-c6856c1e0a9e service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:19.037745 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-d9d1f88d-71bc-4fb4-af44-86959fbd5a9f req-769db48a-e686-478d-a6d9-c6856c1e0a9e service nova] Creating event network-changed:b80323e3-bd2f-48b9-82a7-28c8dd1a9084 for instance 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a on hv-cinder-85694 Sep 11 08:48:19.045722 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-d9d1f88d-71bc-4fb4-af44-86959fbd5a9f req-769db48a-e686-478d-a6d9-c6856c1e0a9e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041036 Sep 11 08:48:19.047346 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 99/193] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:48:19.349646 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:19.360347 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:19.375362 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:19.376492 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:19.377012 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:19.378400 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:19.379191 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:19.379964 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:19.404509 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] HTTP exception thrown: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Request method failure captured: Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee/os-volume_attachments HTTP/1.1 Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaB4dNfC7RFqPORuJhZ7LUwkP-z5A0QJf55A9aAfXuN6Yja15SjgoPyH2EAAzOUO93_d81bhsxzZP8yeqevKGl7G8hUR-ELEvAK0C6BodqgX_nyiMSA93hq8HhV1pcrTB6r4QPLqGsa75oggnWpZiYadntwYQivByCrs5z7f4EuumaM Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 7df041c538da419d8576d746b392c4db Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:48:19.407856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7df041c538da419d8576d746b392c4db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7df041c538da419d8576d746b392c4db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7df041c538da419d8576d746b392c4db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7df041c538da419d8576d746b392c4db", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 7df041c538da419d8576d746b392c4db Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-DeleteServersTestJSON-758084065-project Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 00407384465c41848ad28a15729a95d6 Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-DeleteServersTestJSON-758084065-project Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:19.413899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'server_id': 'c76ea279-a179-4979-aa4f-e7cde772d1ee'} Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:48:19.414671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:19.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:19.416873 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Returning 404 to user: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:48:19.416873 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c8e6284e-b148-4b23-92be-3b3446c9a9f7 tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066849 Sep 11 08:48:19.416873 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 95/194] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:48:19 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:48:19.673085 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f433db8d-e73a-4ddb-a413-2c54e7ce7eb6 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:19.674748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f433db8d-e73a-4ddb-a413-2c54e7ce7eb6 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:19.682241 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f433db8d-e73a-4ddb-a413-2c54e7ce7eb6 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:19.683099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f433db8d-e73a-4ddb-a413-2c54e7ce7eb6 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:19.683789 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f433db8d-e73a-4ddb-a413-2c54e7ce7eb6 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:19.684777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f433db8d-e73a-4ddb-a413-2c54e7ce7eb6 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:19.685491 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f433db8d-e73a-4ddb-a413-2c54e7ce7eb6 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:19.686136 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f433db8d-e73a-4ddb-a413-2c54e7ce7eb6 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:19.708191 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1aea64ce-a5ac-4e25-ae2f-904c5e771de4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:19.708191 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1aea64ce-a5ac-4e25-ae2f-904c5e771de4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:19.717640 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1aea64ce-a5ac-4e25-ae2f-904c5e771de4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:19.718131 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1aea64ce-a5ac-4e25-ae2f-904c5e771de4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:19.720487 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1aea64ce-a5ac-4e25-ae2f-904c5e771de4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:19.721262 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1aea64ce-a5ac-4e25-ae2f-904c5e771de4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:19.721729 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1aea64ce-a5ac-4e25-ae2f-904c5e771de4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:19.722190 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1aea64ce-a5ac-4e25-ae2f-904c5e771de4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:19.754784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=8 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:19.911389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f433db8d-e73a-4ddb-a413-2c54e7ce7eb6 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:19.930838 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f433db8d-e73a-4ddb-a413-2c54e7ce7eb6 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.256436 Sep 11 08:48:19.949582 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 100/195] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:19 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:20.004275 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1aea64ce-a5ac-4e25-ae2f-904c5e771de4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:20.016369 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1aea64ce-a5ac-4e25-ae2f-904c5e771de4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.318951 Sep 11 08:48:20.016975 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 96/196] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:19 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:20.961620 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-42c3ff52-0dbe-4cb4-8eb1-588d7e166bdd tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:20.962326 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-42c3ff52-0dbe-4cb4-8eb1-588d7e166bdd tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:20.964658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:20.970512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42c3ff52-0dbe-4cb4-8eb1-588d7e166bdd tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:20.971322 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42c3ff52-0dbe-4cb4-8eb1-588d7e166bdd tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:20.972080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42c3ff52-0dbe-4cb4-8eb1-588d7e166bdd tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:20.973130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42c3ff52-0dbe-4cb4-8eb1-588d7e166bdd tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:20.973646 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42c3ff52-0dbe-4cb4-8eb1-588d7e166bdd tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:20.974305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-42c3ff52-0dbe-4cb4-8eb1-588d7e166bdd tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:21.043721 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4404dbd2-a8e5-4f13-857e-548530ec83eb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:21.045116 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4404dbd2-a8e5-4f13-857e-548530ec83eb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:21.052826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4404dbd2-a8e5-4f13-857e-548530ec83eb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:21.053314 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4404dbd2-a8e5-4f13-857e-548530ec83eb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:21.054319 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4404dbd2-a8e5-4f13-857e-548530ec83eb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:21.055412 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4404dbd2-a8e5-4f13-857e-548530ec83eb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:21.056062 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4404dbd2-a8e5-4f13-857e-548530ec83eb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:21.056484 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4404dbd2-a8e5-4f13-857e-548530ec83eb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:21.236769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-42c3ff52-0dbe-4cb4-8eb1-588d7e166bdd tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:21.249924 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-42c3ff52-0dbe-4cb4-8eb1-588d7e166bdd tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.292405 Sep 11 08:48:21.250947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 101/197] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:20 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:21.510416 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4404dbd2-a8e5-4f13-857e-548530ec83eb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:21.519208 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4404dbd2-a8e5-4f13-857e-548530ec83eb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.479624 Sep 11 08:48:21.519795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 97/198] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:21 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:22.282453 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ef0dda7d-493a-4cf4-a824-8b6dff653311 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:22.283073 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ef0dda7d-493a-4cf4-a824-8b6dff653311 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:22.289961 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ef0dda7d-493a-4cf4-a824-8b6dff653311 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:22.290536 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ef0dda7d-493a-4cf4-a824-8b6dff653311 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:22.290981 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ef0dda7d-493a-4cf4-a824-8b6dff653311 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:22.291762 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ef0dda7d-493a-4cf4-a824-8b6dff653311 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:22.292204 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ef0dda7d-493a-4cf4-a824-8b6dff653311 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:22.292631 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ef0dda7d-493a-4cf4-a824-8b6dff653311 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:22.544300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e3f016bc-fee6-4b73-8e10-d1ae928c3803 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:22.545073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e3f016bc-fee6-4b73-8e10-d1ae928c3803 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:22.552629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e3f016bc-fee6-4b73-8e10-d1ae928c3803 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:22.553121 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e3f016bc-fee6-4b73-8e10-d1ae928c3803 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:22.553554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e3f016bc-fee6-4b73-8e10-d1ae928c3803 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:22.554829 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e3f016bc-fee6-4b73-8e10-d1ae928c3803 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:22.555647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e3f016bc-fee6-4b73-8e10-d1ae928c3803 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:22.556350 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e3f016bc-fee6-4b73-8e10-d1ae928c3803 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:22.791290 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e3f016bc-fee6-4b73-8e10-d1ae928c3803 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:22.802441 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e3f016bc-fee6-4b73-8e10-d1ae928c3803 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.262147 Sep 11 08:48:22.805714 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 98/199] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:22 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:23.052936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ef0dda7d-493a-4cf4-a824-8b6dff653311 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:23.067374 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ef0dda7d-493a-4cf4-a824-8b6dff653311 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.789186 Sep 11 08:48:23.067993 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 102/200] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:22 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:23.830991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-88982ad1-4f89-4d5f-92f9-c156a537cf65 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:23.832129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-88982ad1-4f89-4d5f-92f9-c156a537cf65 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:23.840512 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88982ad1-4f89-4d5f-92f9-c156a537cf65 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:23.841272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88982ad1-4f89-4d5f-92f9-c156a537cf65 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:23.841812 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88982ad1-4f89-4d5f-92f9-c156a537cf65 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:23.842796 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88982ad1-4f89-4d5f-92f9-c156a537cf65 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:23.843414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88982ad1-4f89-4d5f-92f9-c156a537cf65 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:23.844120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88982ad1-4f89-4d5f-92f9-c156a537cf65 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:24.064422 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-88982ad1-4f89-4d5f-92f9-c156a537cf65 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:24.079090 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-88982ad1-4f89-4d5f-92f9-c156a537cf65 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.252592 Sep 11 08:48:24.079807 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 99/201] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:23 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:24.107059 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3d23af10-a2bf-4469-99f7-e4b19b0ae604 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:24.110244 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3d23af10-a2bf-4469-99f7-e4b19b0ae604 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:24.126016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d23af10-a2bf-4469-99f7-e4b19b0ae604 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:24.129052 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d23af10-a2bf-4469-99f7-e4b19b0ae604 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:24.130558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d23af10-a2bf-4469-99f7-e4b19b0ae604 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:24.131367 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d23af10-a2bf-4469-99f7-e4b19b0ae604 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:24.131886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d23af10-a2bf-4469-99f7-e4b19b0ae604 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:24.132485 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d23af10-a2bf-4469-99f7-e4b19b0ae604 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:24.302053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:24.302916 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:24.316031 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:24.316602 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:24.317267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:24.318054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:24.318601 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:24.327460 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:24.354065 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] HTTP exception thrown: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Request method failure captured: Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: DELETE /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee HTTP/1.1 Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaB4dNfC7RFqPORuJhZ7LUwkP-z5A0QJf55A9aAfXuN6Yja15SjgoPyH2EAAzOUO93_d81bhsxzZP8yeqevKGl7G8hUR-ELEvAK0C6BodqgX_nyiMSA93hq8HhV1pcrTB6r4QPLqGsa75oggnWpZiYadntwYQivByCrs5z7f4EuumaM Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 7df041c538da419d8576d746b392c4db Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:48:24.356385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7df041c538da419d8576d746b392c4db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7df041c538da419d8576d746b392c4db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7df041c538da419d8576d746b392c4db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7df041c538da419d8576d746b392c4db", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 7df041c538da419d8576d746b392c4db Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-DeleteServersTestJSON-758084065-project Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 00407384465c41848ad28a15729a95d6 Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-DeleteServersTestJSON-758084065-project Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:24.357995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'c76ea279-a179-4979-aa4f-e7cde772d1ee'} Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:48:24.358854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:24.360160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:24.362973 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Returning 404 to user: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:48:24.363843 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4ae11f4d-181e-41fb-9163-da3dbb4620df tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 404 len: 111 microversion: 2.1 time: 0.070112 Sep 11 08:48:24.364418 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 100/202] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:48:24 2022] DELETE /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:48:24.378652 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:24.379493 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] [instance: c76ea279-a179-4979-aa4f-e7cde772d1ee] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:24.386173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:24.386736 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:24.387173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:24.387931 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:24.388444 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:24.388870 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:24.405627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] HTTP exception thrown: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Request method failure captured: Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee HTTP/1.1 Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaB4dNfC7RFqPORuJhZ7LUwkP-z5A0QJf55A9aAfXuN6Yja15SjgoPyH2EAAzOUO93_d81bhsxzZP8yeqevKGl7G8hUR-ELEvAK0C6BodqgX_nyiMSA93hq8HhV1pcrTB6r4QPLqGsa75oggnWpZiYadntwYQivByCrs5z7f4EuumaM Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 7df041c538da419d8576d746b392c4db Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:48:24.407272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7df041c538da419d8576d746b392c4db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7df041c538da419d8576d746b392c4db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7df041c538da419d8576d746b392c4db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7df041c538da419d8576d746b392c4db", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 7df041c538da419d8576d746b392c4db Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-DeleteServersTestJSON-758084065 Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-DeleteServersTestJSON-758084065-project Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 00407384465c41848ad28a15729a95d6 Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-DeleteServersTestJSON-758084065-project Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:24.408454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'c76ea279-a179-4979-aa4f-e7cde772d1ee'} Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:48:24.409195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. Sep 11 08:48:24.410274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:24.411244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] Returning 404 to user: Instance c76ea279-a179-4979-aa4f-e7cde772d1ee could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:48:24.411244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ec41d570-cb0b-4182-978f-f1514970696d tempest-DeleteServersTestJSON-758084065 tempest-DeleteServersTestJSON-758084065-project] 10.222.0.44 "GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee" status: 404 len: 111 microversion: 2.1 time: 0.034361 Sep 11 08:48:24.413489 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 101/203] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:24 2022] GET /compute/v2.1/servers/c76ea279-a179-4979-aa4f-e7cde772d1ee => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 08:48:24.437872 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3d23af10-a2bf-4469-99f7-e4b19b0ae604 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:24.453076 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3d23af10-a2bf-4469-99f7-e4b19b0ae604 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.352115 Sep 11 08:48:24.455041 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 103/204] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:24 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:25.114839 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e034661d-a4a4-4721-9ce8-7ceb2950df5c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:25.116058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e034661d-a4a4-4721-9ce8-7ceb2950df5c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:25.130325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e034661d-a4a4-4721-9ce8-7ceb2950df5c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:25.132335 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e034661d-a4a4-4721-9ce8-7ceb2950df5c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:25.134541 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e034661d-a4a4-4721-9ce8-7ceb2950df5c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:25.136318 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e034661d-a4a4-4721-9ce8-7ceb2950df5c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:25.137535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e034661d-a4a4-4721-9ce8-7ceb2950df5c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:25.138824 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e034661d-a4a4-4721-9ce8-7ceb2950df5c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:25.506498 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a1ce5076-60fd-431c-9857-7c4caa53d4ef tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:25.507946 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a1ce5076-60fd-431c-9857-7c4caa53d4ef tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:25.509788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e034661d-a4a4-4721-9ce8-7ceb2950df5c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:25.517032 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a1ce5076-60fd-431c-9857-7c4caa53d4ef tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:25.517849 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a1ce5076-60fd-431c-9857-7c4caa53d4ef tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:25.518560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a1ce5076-60fd-431c-9857-7c4caa53d4ef tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:25.520219 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a1ce5076-60fd-431c-9857-7c4caa53d4ef tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:25.520827 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a1ce5076-60fd-431c-9857-7c4caa53d4ef tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:25.521328 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a1ce5076-60fd-431c-9857-7c4caa53d4ef tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:25.526398 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e034661d-a4a4-4721-9ce8-7ceb2950df5c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.422601 Sep 11 08:48:25.527158 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 102/205] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:25 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:25.815894 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a1ce5076-60fd-431c-9857-7c4caa53d4ef tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:25.825544 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a1ce5076-60fd-431c-9857-7c4caa53d4ef tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.325406 Sep 11 08:48:25.839948 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 104/206] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:25 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:26.557533 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bcb101e3-aef9-49af-8544-6a8fc7412097 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:26.559064 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bcb101e3-aef9-49af-8544-6a8fc7412097 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:26.569126 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcb101e3-aef9-49af-8544-6a8fc7412097 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:26.570117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcb101e3-aef9-49af-8544-6a8fc7412097 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:26.570918 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcb101e3-aef9-49af-8544-6a8fc7412097 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:26.571792 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcb101e3-aef9-49af-8544-6a8fc7412097 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:26.572255 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcb101e3-aef9-49af-8544-6a8fc7412097 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:26.572681 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcb101e3-aef9-49af-8544-6a8fc7412097 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:26.854773 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-97d17789-8414-4a1c-9a60-0fd6f356ec9d tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:26.856142 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-97d17789-8414-4a1c-9a60-0fd6f356ec9d tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:26.863813 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97d17789-8414-4a1c-9a60-0fd6f356ec9d tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:26.864714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97d17789-8414-4a1c-9a60-0fd6f356ec9d tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:26.867374 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97d17789-8414-4a1c-9a60-0fd6f356ec9d tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:26.868416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97d17789-8414-4a1c-9a60-0fd6f356ec9d tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:26.869240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97d17789-8414-4a1c-9a60-0fd6f356ec9d tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:26.869886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97d17789-8414-4a1c-9a60-0fd6f356ec9d tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:27.096814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bcb101e3-aef9-49af-8544-6a8fc7412097 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:27.108079 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bcb101e3-aef9-49af-8544-6a8fc7412097 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.555008 Sep 11 08:48:27.118751 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 103/207] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:26 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:27.225059 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-97d17789-8414-4a1c-9a60-0fd6f356ec9d tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:27.313702 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-97d17789-8414-4a1c-9a60-0fd6f356ec9d tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.459944 Sep 11 08:48:27.318728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 105/208] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:26 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:28.140084 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-77e7c1c2-3e3f-476f-a711-ce0ebc681040 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:28.140676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-77e7c1c2-3e3f-476f-a711-ce0ebc681040 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:28.165698 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77e7c1c2-3e3f-476f-a711-ce0ebc681040 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:28.170001 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77e7c1c2-3e3f-476f-a711-ce0ebc681040 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:28.170689 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77e7c1c2-3e3f-476f-a711-ce0ebc681040 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:28.171986 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77e7c1c2-3e3f-476f-a711-ce0ebc681040 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:28.172738 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77e7c1c2-3e3f-476f-a711-ce0ebc681040 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:28.183074 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77e7c1c2-3e3f-476f-a711-ce0ebc681040 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:28.354926 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0c620e58-80ac-42d1-9d84-36fff9bbc763 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:28.357310 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0c620e58-80ac-42d1-9d84-36fff9bbc763 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:28.380639 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0c620e58-80ac-42d1-9d84-36fff9bbc763 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:28.381437 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0c620e58-80ac-42d1-9d84-36fff9bbc763 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:28.383353 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0c620e58-80ac-42d1-9d84-36fff9bbc763 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:28.384538 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0c620e58-80ac-42d1-9d84-36fff9bbc763 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:28.385185 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0c620e58-80ac-42d1-9d84-36fff9bbc763 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:28.387864 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0c620e58-80ac-42d1-9d84-36fff9bbc763 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:28.412191 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:28.521770 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-77e7c1c2-3e3f-476f-a711-ce0ebc681040 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:28.533996 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-77e7c1c2-3e3f-476f-a711-ce0ebc681040 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.404040 Sep 11 08:48:28.556418 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 104/209] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:28 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:28.795070 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0c620e58-80ac-42d1-9d84-36fff9bbc763 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:28.811954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0c620e58-80ac-42d1-9d84-36fff9bbc763 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.461439 Sep 11 08:48:28.812798 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 106/210] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:28 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:29.572712 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8d199832-bedb-4faa-9d1d-6fb64d597b40 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:29.574583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8d199832-bedb-4faa-9d1d-6fb64d597b40 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:29.589617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d199832-bedb-4faa-9d1d-6fb64d597b40 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:29.594302 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d199832-bedb-4faa-9d1d-6fb64d597b40 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:29.595703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d199832-bedb-4faa-9d1d-6fb64d597b40 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:29.596464 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d199832-bedb-4faa-9d1d-6fb64d597b40 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:29.596944 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d199832-bedb-4faa-9d1d-6fb64d597b40 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:29.597371 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d199832-bedb-4faa-9d1d-6fb64d597b40 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:29.869814 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-91c06d21-62d2-41ed-8a18-00a5bcd264bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:29.871963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-91c06d21-62d2-41ed-8a18-00a5bcd264bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:29.879984 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-91c06d21-62d2-41ed-8a18-00a5bcd264bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:29.880756 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-91c06d21-62d2-41ed-8a18-00a5bcd264bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:29.881355 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-91c06d21-62d2-41ed-8a18-00a5bcd264bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:29.882638 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-91c06d21-62d2-41ed-8a18-00a5bcd264bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:29.883909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-91c06d21-62d2-41ed-8a18-00a5bcd264bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:29.884508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-91c06d21-62d2-41ed-8a18-00a5bcd264bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:29.901633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8d199832-bedb-4faa-9d1d-6fb64d597b40 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:29.928320 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8d199832-bedb-4faa-9d1d-6fb64d597b40 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.362561 Sep 11 08:48:29.929384 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 105/211] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:29 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:30.690207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-91c06d21-62d2-41ed-8a18-00a5bcd264bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:30.699236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-91c06d21-62d2-41ed-8a18-00a5bcd264bf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.833761 Sep 11 08:48:30.699826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 107/212] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:29 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:30.955474 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-11acf2d2-1223-487a-af1e-af5bf992feda tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:30.956113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-11acf2d2-1223-487a-af1e-af5bf992feda tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:30.965526 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-11acf2d2-1223-487a-af1e-af5bf992feda tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:30.971514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-11acf2d2-1223-487a-af1e-af5bf992feda tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:30.976026 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-11acf2d2-1223-487a-af1e-af5bf992feda tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:30.976026 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-11acf2d2-1223-487a-af1e-af5bf992feda tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:30.976026 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-11acf2d2-1223-487a-af1e-af5bf992feda tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:30.976026 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-11acf2d2-1223-487a-af1e-af5bf992feda tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:31.436926 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-11acf2d2-1223-487a-af1e-af5bf992feda tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:31.446292 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-11acf2d2-1223-487a-af1e-af5bf992feda tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1518 microversion: 2.1 time: 0.496057 Sep 11 08:48:31.446891 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 106/213] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:30 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1518 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:31.513305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-75c925c2-f9ae-4af1-a8d3-0f0b287513eb req-eeb1c50d-22ea-457e-b63b-1a4ab078c14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe2eda9-45e2-4ce1-b1e3-313957f3d04a", "name": "network-vif-plugged", "status": "completed", "tag": "b80323e3-bd2f-48b9-82a7-28c8dd1a9084"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:31.542768 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-75c925c2-f9ae-4af1-a8d3-0f0b287513eb req-eeb1c50d-22ea-457e-b63b-1a4ab078c14d service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:31.543560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-75c925c2-f9ae-4af1-a8d3-0f0b287513eb req-eeb1c50d-22ea-457e-b63b-1a4ab078c14d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:31.544614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-75c925c2-f9ae-4af1-a8d3-0f0b287513eb req-eeb1c50d-22ea-457e-b63b-1a4ab078c14d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:31.562486 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-75c925c2-f9ae-4af1-a8d3-0f0b287513eb req-eeb1c50d-22ea-457e-b63b-1a4ab078c14d service nova] Creating event network-vif-plugged:b80323e3-bd2f-48b9-82a7-28c8dd1a9084 for instance 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a on hv-cinder-85694 Sep 11 08:48:31.573229 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-75c925c2-f9ae-4af1-a8d3-0f0b287513eb req-eeb1c50d-22ea-457e-b63b-1a4ab078c14d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064495 Sep 11 08:48:31.575291 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 108/214] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:48:31.722764 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f7488f43-02a6-45ba-830c-f6a5f362356c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:31.723709 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f7488f43-02a6-45ba-830c-f6a5f362356c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:31.730366 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7488f43-02a6-45ba-830c-f6a5f362356c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:31.735611 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7488f43-02a6-45ba-830c-f6a5f362356c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:31.736264 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7488f43-02a6-45ba-830c-f6a5f362356c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:31.740527 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7488f43-02a6-45ba-830c-f6a5f362356c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:31.741163 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7488f43-02a6-45ba-830c-f6a5f362356c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:31.741596 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7488f43-02a6-45ba-830c-f6a5f362356c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:32.079723 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f7488f43-02a6-45ba-830c-f6a5f362356c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:32.095503 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f7488f43-02a6-45ba-830c-f6a5f362356c tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.376092 Sep 11 08:48:32.097150 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 107/215] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:31 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:32.474716 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b6ef29a9-56e2-4bc0-aed3-a16c5479253e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:32.476895 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b6ef29a9-56e2-4bc0-aed3-a16c5479253e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:32.485008 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6ef29a9-56e2-4bc0-aed3-a16c5479253e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:32.486076 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6ef29a9-56e2-4bc0-aed3-a16c5479253e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:32.488029 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6ef29a9-56e2-4bc0-aed3-a16c5479253e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:32.489122 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6ef29a9-56e2-4bc0-aed3-a16c5479253e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:32.489763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6ef29a9-56e2-4bc0-aed3-a16c5479253e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:32.491261 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6ef29a9-56e2-4bc0-aed3-a16c5479253e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:32.974995 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b6ef29a9-56e2-4bc0-aed3-a16c5479253e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:32.994186 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b6ef29a9-56e2-4bc0-aed3-a16c5479253e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1498 microversion: 2.1 time: 0.524062 Sep 11 08:48:32.995428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 109/216] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:32 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1498 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:33.019169 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-19a452fd-76eb-4c12-b718-ea2992d435a8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:33.020282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-19a452fd-76eb-4c12-b718-ea2992d435a8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:33.028391 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19a452fd-76eb-4c12-b718-ea2992d435a8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:33.029597 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19a452fd-76eb-4c12-b718-ea2992d435a8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:33.030395 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19a452fd-76eb-4c12-b718-ea2992d435a8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:33.031511 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19a452fd-76eb-4c12-b718-ea2992d435a8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:33.032319 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19a452fd-76eb-4c12-b718-ea2992d435a8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:33.033158 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19a452fd-76eb-4c12-b718-ea2992d435a8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:33.122216 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-96b9b5b4-02c2-48b3-aa85-d479bcf56e73 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:33.122490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-96b9b5b4-02c2-48b3-aa85-d479bcf56e73 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:33.134714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-96b9b5b4-02c2-48b3-aa85-d479bcf56e73 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:33.135320 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-96b9b5b4-02c2-48b3-aa85-d479bcf56e73 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:33.135772 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-96b9b5b4-02c2-48b3-aa85-d479bcf56e73 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:33.138854 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-96b9b5b4-02c2-48b3-aa85-d479bcf56e73 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:33.139331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-96b9b5b4-02c2-48b3-aa85-d479bcf56e73 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:33.142301 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-96b9b5b4-02c2-48b3-aa85-d479bcf56e73 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:33.305696 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-19a452fd-76eb-4c12-b718-ea2992d435a8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:33.361254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-19a452fd-76eb-4c12-b718-ea2992d435a8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1514 microversion: 2.1 time: 0.346122 Sep 11 08:48:33.362390 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 108/217] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:33 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:33.563980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-96b9b5b4-02c2-48b3-aa85-d479bcf56e73 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:33.576473 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-96b9b5b4-02c2-48b3-aa85-d479bcf56e73 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.459028 Sep 11 08:48:33.577387 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 110/218] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:33 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:34.624023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-18cdcfb2-18bc-4623-9e72-723495c9e572 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:34.624587 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-18cdcfb2-18bc-4623-9e72-723495c9e572 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:34.633167 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18cdcfb2-18bc-4623-9e72-723495c9e572 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:34.633663 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18cdcfb2-18bc-4623-9e72-723495c9e572 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:34.634097 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18cdcfb2-18bc-4623-9e72-723495c9e572 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:34.634841 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18cdcfb2-18bc-4623-9e72-723495c9e572 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:34.635294 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18cdcfb2-18bc-4623-9e72-723495c9e572 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:34.635721 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18cdcfb2-18bc-4623-9e72-723495c9e572 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:34.812907 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-18cdcfb2-18bc-4623-9e72-723495c9e572 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:34.815287 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=100 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:34.823275 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-18cdcfb2-18bc-4623-9e72-723495c9e572 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.205963 Sep 11 08:48:34.838589 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 109/219] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:34 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:35.848450 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-539cbe18-85df-48aa-a361-acacf3610401 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:35.852358 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-539cbe18-85df-48aa-a361-acacf3610401 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:35.868698 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539cbe18-85df-48aa-a361-acacf3610401 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:35.871821 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539cbe18-85df-48aa-a361-acacf3610401 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:35.871821 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539cbe18-85df-48aa-a361-acacf3610401 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:35.871821 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539cbe18-85df-48aa-a361-acacf3610401 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:35.872291 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539cbe18-85df-48aa-a361-acacf3610401 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:35.873039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539cbe18-85df-48aa-a361-acacf3610401 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:36.176287 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-539cbe18-85df-48aa-a361-acacf3610401 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:36.185881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-539cbe18-85df-48aa-a361-acacf3610401 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.342462 Sep 11 08:48:36.207172 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 111/220] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:35 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:37.211179 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-44153293-b665-45bd-8755-68f2d1ba0c13 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:37.212294 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-44153293-b665-45bd-8755-68f2d1ba0c13 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:37.236144 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44153293-b665-45bd-8755-68f2d1ba0c13 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:37.236885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44153293-b665-45bd-8755-68f2d1ba0c13 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:37.237671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44153293-b665-45bd-8755-68f2d1ba0c13 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:37.243703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44153293-b665-45bd-8755-68f2d1ba0c13 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:37.243988 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44153293-b665-45bd-8755-68f2d1ba0c13 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:37.245010 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44153293-b665-45bd-8755-68f2d1ba0c13 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:37.539178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-44153293-b665-45bd-8755-68f2d1ba0c13 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:37.555292 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-44153293-b665-45bd-8755-68f2d1ba0c13 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1314 microversion: 2.1 time: 0.346257 Sep 11 08:48:37.559338 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 110/221] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:37 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:37.935796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-34793c64-643a-4664-aa7a-44ba7a56937c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:37.938020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-34793c64-643a-4664-aa7a-44ba7a56937c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:37.952922 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34793c64-643a-4664-aa7a-44ba7a56937c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:37.954012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34793c64-643a-4664-aa7a-44ba7a56937c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:37.956460 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34793c64-643a-4664-aa7a-44ba7a56937c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:37.966326 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34793c64-643a-4664-aa7a-44ba7a56937c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:37.967920 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34793c64-643a-4664-aa7a-44ba7a56937c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:37.972341 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34793c64-643a-4664-aa7a-44ba7a56937c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:38.038775 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-34793c64-643a-4664-aa7a-44ba7a56937c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lazy-loading 'flavor' on Instance uuid 9bbdc2f9-9111-44ca-b51e-5af1c6069184 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:48:38.585243 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6cd468cb-955f-49b9-97cd-d172370a8716 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:38.586294 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6cd468cb-955f-49b9-97cd-d172370a8716 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:38.589888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-34793c64-643a-4664-aa7a-44ba7a56937c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "POST /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184/action" status: 200 len: 32 microversion: 2.1 time: 0.660035 Sep 11 08:48:38.611364 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 112/222] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:48:37 2022] POST /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184/action => generated 32 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 08:48:38.685508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2f3c0f1c-92d8-4cc2-86b1-d89e7ca18821 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:38.685808 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6cd468cb-955f-49b9-97cd-d172370a8716 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:38.686707 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6cd468cb-955f-49b9-97cd-d172370a8716 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:38.686849 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2f3c0f1c-92d8-4cc2-86b1-d89e7ca18821 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:38.689566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6cd468cb-955f-49b9-97cd-d172370a8716 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:38.692537 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6cd468cb-955f-49b9-97cd-d172370a8716 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:38.693314 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6cd468cb-955f-49b9-97cd-d172370a8716 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:38.697010 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6cd468cb-955f-49b9-97cd-d172370a8716 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:38.722649 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2f3c0f1c-92d8-4cc2-86b1-d89e7ca18821 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:38.728769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2f3c0f1c-92d8-4cc2-86b1-d89e7ca18821 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:38.729572 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2f3c0f1c-92d8-4cc2-86b1-d89e7ca18821 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:38.731438 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2f3c0f1c-92d8-4cc2-86b1-d89e7ca18821 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:38.732241 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2f3c0f1c-92d8-4cc2-86b1-d89e7ca18821 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:38.733259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2f3c0f1c-92d8-4cc2-86b1-d89e7ca18821 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:39.032830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6cd468cb-955f-49b9-97cd-d172370a8716 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:39.047534 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6cd468cb-955f-49b9-97cd-d172370a8716 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1496 microversion: 2.1 time: 0.470041 Sep 11 08:48:39.048305 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 111/223] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:38 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1496 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:39.200125 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2f3c0f1c-92d8-4cc2-86b1-d89e7ca18821 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:39.214036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2f3c0f1c-92d8-4cc2-86b1-d89e7ca18821 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.595494 Sep 11 08:48:39.216015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 113/224] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:38 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:40.250272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-80a46cf4-8cb7-4e17-8bc8-c5d41d607f25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:40.251110 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-80a46cf4-8cb7-4e17-8bc8-c5d41d607f25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:40.260011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-80a46cf4-8cb7-4e17-8bc8-c5d41d607f25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:40.260509 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-80a46cf4-8cb7-4e17-8bc8-c5d41d607f25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:40.260936 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-80a46cf4-8cb7-4e17-8bc8-c5d41d607f25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:40.263448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-80a46cf4-8cb7-4e17-8bc8-c5d41d607f25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:40.266513 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-80a46cf4-8cb7-4e17-8bc8-c5d41d607f25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:40.267582 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-80a46cf4-8cb7-4e17-8bc8-c5d41d607f25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:40.666351 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f31dd189-73ac-4b0c-94b1-e815f8aa76cb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:40.667177 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f31dd189-73ac-4b0c-94b1-e815f8aa76cb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:40.675900 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f31dd189-73ac-4b0c-94b1-e815f8aa76cb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:40.676672 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f31dd189-73ac-4b0c-94b1-e815f8aa76cb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:40.677303 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f31dd189-73ac-4b0c-94b1-e815f8aa76cb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:40.678971 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f31dd189-73ac-4b0c-94b1-e815f8aa76cb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:40.679634 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f31dd189-73ac-4b0c-94b1-e815f8aa76cb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:40.680561 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f31dd189-73ac-4b0c-94b1-e815f8aa76cb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:40.763859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-80a46cf4-8cb7-4e17-8bc8-c5d41d607f25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:40.776932 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f31dd189-73ac-4b0c-94b1-e815f8aa76cb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Going to try to terminate instance {{(pid=127646) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:48:40.817783 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-80a46cf4-8cb7-4e17-8bc8-c5d41d607f25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.571207 Sep 11 08:48:40.826118 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 112/225] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:40 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:41.245675 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f31dd189-73ac-4b0c-94b1-e815f8aa76cb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 204 len: 0 microversion: 2.1 time: 0.578974 Sep 11 08:48:41.245675 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 114/226] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:48:40 2022] DELETE /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:48:41.255103 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b7ac3096-5d4d-4ea6-8c1a-12e07b0d7d62 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:41.255979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b7ac3096-5d4d-4ea6-8c1a-12e07b0d7d62 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:41.266351 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ac3096-5d4d-4ea6-8c1a-12e07b0d7d62 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:41.267346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ac3096-5d4d-4ea6-8c1a-12e07b0d7d62 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:41.267951 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ac3096-5d4d-4ea6-8c1a-12e07b0d7d62 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:41.268911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ac3096-5d4d-4ea6-8c1a-12e07b0d7d62 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:41.270024 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ac3096-5d4d-4ea6-8c1a-12e07b0d7d62 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:41.274458 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ac3096-5d4d-4ea6-8c1a-12e07b0d7d62 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:41.543584 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b7ac3096-5d4d-4ea6-8c1a-12e07b0d7d62 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:41.553662 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b7ac3096-5d4d-4ea6-8c1a-12e07b0d7d62 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1502 microversion: 2.1 time: 0.302526 Sep 11 08:48:41.595760 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 113/227] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:41 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:41.869067 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b4531e87-9a93-4536-94f7-5e719aaf6050 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:41.869816 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b4531e87-9a93-4536-94f7-5e719aaf6050 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:41.877589 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b4531e87-9a93-4536-94f7-5e719aaf6050 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:41.877994 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b4531e87-9a93-4536-94f7-5e719aaf6050 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:41.878507 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b4531e87-9a93-4536-94f7-5e719aaf6050 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:41.879595 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b4531e87-9a93-4536-94f7-5e719aaf6050 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:41.880415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b4531e87-9a93-4536-94f7-5e719aaf6050 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:41.880877 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b4531e87-9a93-4536-94f7-5e719aaf6050 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:42.104181 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b4531e87-9a93-4536-94f7-5e719aaf6050 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:42.113955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b4531e87-9a93-4536-94f7-5e719aaf6050 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.250213 Sep 11 08:48:42.114573 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 115/228] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:41 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:42.635930 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-be81ec25-36f4-44ab-8dec-c1c52b887c66 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:42.638869 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-be81ec25-36f4-44ab-8dec-c1c52b887c66 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:42.657250 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be81ec25-36f4-44ab-8dec-c1c52b887c66 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:42.658014 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be81ec25-36f4-44ab-8dec-c1c52b887c66 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:42.658654 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be81ec25-36f4-44ab-8dec-c1c52b887c66 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:42.659526 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be81ec25-36f4-44ab-8dec-c1c52b887c66 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:42.660129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be81ec25-36f4-44ab-8dec-c1c52b887c66 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:42.660729 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be81ec25-36f4-44ab-8dec-c1c52b887c66 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:42.869859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-be81ec25-36f4-44ab-8dec-c1c52b887c66 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:42.887407 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-be81ec25-36f4-44ab-8dec-c1c52b887c66 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1502 microversion: 2.1 time: 0.270000 Sep 11 08:48:42.888302 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 114/229] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:42 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1502 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:43.151021 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1d534c3f-8d94-4244-bc9b-0adc5f6f1dce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:43.153577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1d534c3f-8d94-4244-bc9b-0adc5f6f1dce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:43.174719 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d534c3f-8d94-4244-bc9b-0adc5f6f1dce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:43.176155 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d534c3f-8d94-4244-bc9b-0adc5f6f1dce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:43.177317 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d534c3f-8d94-4244-bc9b-0adc5f6f1dce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:43.181719 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d534c3f-8d94-4244-bc9b-0adc5f6f1dce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:43.183863 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d534c3f-8d94-4244-bc9b-0adc5f6f1dce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:43.188187 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d534c3f-8d94-4244-bc9b-0adc5f6f1dce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:43.585571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1d534c3f-8d94-4244-bc9b-0adc5f6f1dce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:43.601392 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1d534c3f-8d94-4244-bc9b-0adc5f6f1dce tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.465251 Sep 11 08:48:43.603545 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 116/230] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:43 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:43.913831 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1073822d-9d48-4e32-941f-5ba45a4f7478 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:43.916901 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1073822d-9d48-4e32-941f-5ba45a4f7478 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:43.931937 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1073822d-9d48-4e32-941f-5ba45a4f7478 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:43.932821 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1073822d-9d48-4e32-941f-5ba45a4f7478 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:43.933417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1073822d-9d48-4e32-941f-5ba45a4f7478 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:43.934485 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1073822d-9d48-4e32-941f-5ba45a4f7478 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:43.935094 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1073822d-9d48-4e32-941f-5ba45a4f7478 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:43.935690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1073822d-9d48-4e32-941f-5ba45a4f7478 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:44.222755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1073822d-9d48-4e32-941f-5ba45a4f7478 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:44.234925 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1073822d-9d48-4e32-941f-5ba45a4f7478 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1502 microversion: 2.1 time: 0.326119 Sep 11 08:48:44.236450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 115/231] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:43 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1502 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:44.629006 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a352ae49-0b29-4c0d-b5be-526ccf6d355f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:44.631897 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a352ae49-0b29-4c0d-b5be-526ccf6d355f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:44.641146 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a352ae49-0b29-4c0d-b5be-526ccf6d355f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:44.642045 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a352ae49-0b29-4c0d-b5be-526ccf6d355f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:44.642958 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a352ae49-0b29-4c0d-b5be-526ccf6d355f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:44.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a352ae49-0b29-4c0d-b5be-526ccf6d355f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:44.650071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a352ae49-0b29-4c0d-b5be-526ccf6d355f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:44.659606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a352ae49-0b29-4c0d-b5be-526ccf6d355f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:44.772329 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-73720713-c6e1-4bb0-ab58-095b3a4e15e7 req-ecf29fd9-de40-4ae1-832c-98848c65a4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fe2eda9-45e2-4ce1-b1e3-313957f3d04a", "name": "network-vif-deleted", "tag": "b80323e3-bd2f-48b9-82a7-28c8dd1a9084"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:44.791660 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-73720713-c6e1-4bb0-ab58-095b3a4e15e7 req-ecf29fd9-de40-4ae1-832c-98848c65a4dd service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:44.794112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-73720713-c6e1-4bb0-ab58-095b3a4e15e7 req-ecf29fd9-de40-4ae1-832c-98848c65a4dd service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:44.794763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-73720713-c6e1-4bb0-ab58-095b3a4e15e7 req-ecf29fd9-de40-4ae1-832c-98848c65a4dd service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:44.813528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-73720713-c6e1-4bb0-ab58-095b3a4e15e7 req-ecf29fd9-de40-4ae1-832c-98848c65a4dd service nova] Creating event network-vif-deleted:b80323e3-bd2f-48b9-82a7-28c8dd1a9084 for instance 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a on hv-cinder-85694 Sep 11 08:48:44.826022 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-73720713-c6e1-4bb0-ab58-095b3a4e15e7 req-ecf29fd9-de40-4ae1-832c-98848c65a4dd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060326 Sep 11 08:48:44.827880 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 116/232] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:48:45.007612 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a352ae49-0b29-4c0d-b5be-526ccf6d355f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:45.016782 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a352ae49-0b29-4c0d-b5be-526ccf6d355f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.393203 Sep 11 08:48:45.017388 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 117/233] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:44 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:45.261896 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:45.263546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:45.273567 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:45.274524 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:45.275162 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:45.276929 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:45.277629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:45.278288 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:45.351886 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:45.352503 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:45.352970 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:45.353661 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lazy-loading 'fault' on Instance uuid 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:48:45.446270 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:45.460627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d5cea35a-e3a2-4f07-87a1-b7bf0aa78107 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1304 microversion: 2.1 time: 0.202722 Sep 11 08:48:45.461577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 117/234] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:45 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1304 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:46.068571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-be924649-acb5-44f9-84af-5a97e9fe9781 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:46.068571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-be924649-acb5-44f9-84af-5a97e9fe9781 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:46.068571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be924649-acb5-44f9-84af-5a97e9fe9781 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:46.068571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be924649-acb5-44f9-84af-5a97e9fe9781 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:46.070189 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be924649-acb5-44f9-84af-5a97e9fe9781 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:46.070189 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be924649-acb5-44f9-84af-5a97e9fe9781 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:46.072267 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be924649-acb5-44f9-84af-5a97e9fe9781 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:46.072958 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be924649-acb5-44f9-84af-5a97e9fe9781 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:46.289941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-be924649-acb5-44f9-84af-5a97e9fe9781 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:46.300504 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-be924649-acb5-44f9-84af-5a97e9fe9781 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.247672 Sep 11 08:48:46.301242 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 118/235] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:46 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:46.485665 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:46.486496 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:46.493136 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:46.493553 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:46.495156 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:46.495156 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:46.495156 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:46.496226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:46.533183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:46.533663 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:46.534094 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:46.534561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lazy-loading 'fault' on Instance uuid 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:48:46.579130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:46.588086 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5f3c3565-9908-4bca-886e-6cb71b97d170 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 200 len: 1304 microversion: 2.1 time: 0.107362 Sep 11 08:48:46.588741 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 118/236] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:46 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:47.328974 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3663bd5d-3af0-4aec-a1ff-80098d46f733 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:47.330449 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3663bd5d-3af0-4aec-a1ff-80098d46f733 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:47.342121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3663bd5d-3af0-4aec-a1ff-80098d46f733 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:47.342886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3663bd5d-3af0-4aec-a1ff-80098d46f733 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:47.343687 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3663bd5d-3af0-4aec-a1ff-80098d46f733 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:47.345219 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3663bd5d-3af0-4aec-a1ff-80098d46f733 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:47.345992 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3663bd5d-3af0-4aec-a1ff-80098d46f733 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:47.346931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3663bd5d-3af0-4aec-a1ff-80098d46f733 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:47.624914 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:47.629545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:47.652711 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:47.654030 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:47.655491 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:47.657682 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:47.659144 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:47.660346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:47.704917 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3663bd5d-3af0-4aec-a1ff-80098d46f733 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:47.737849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] HTTP exception thrown: Instance 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a could not be found. Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Request method failure captured: Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a HTTP/1.1 Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaDEm7SFsn142VCwr27oXjPEG5fY7vlKemuTWapfiRy9PT4HrOkvXxZafiApEND4N-uobc0HZezOviKmdr7H82zS_ozoBtlkU399ivArZidXV84LnGg3t40VCCFxaUXVqyrwrdbwYRiTxA_SiQeeJCG21bUAM8n8KCUM17M2gIbywbQ Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: ead98e6e89d840a0b99273f28429b4ba Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-VolumesActionsTest-1219148205 Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:48:47.742746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ead98e6e89d840a0b99273f28429b4ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ead98e6e89d840a0b99273f28429b4ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ead98e6e89d840a0b99273f28429b4ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ead98e6e89d840a0b99273f28429b4ba", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-VolumesActionsTest-1219148205 Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: ead98e6e89d840a0b99273f28429b4ba Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-VolumesActionsTest-1219148205 Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-VolumesActionsTest-1219148205-project Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 0b198ff6ed104068b38b993054617f9a Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-VolumesActionsTest-1219148205-project Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a could not be found. Sep 11 08:48:47.744112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': '8fe2eda9-45e2-4ce1-b1e3-313957f3d04a'} Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a could not be found. Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:48:47.744879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a could not be found. Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a could not be found. Sep 11 08:48:47.746107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:48:47.747207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3663bd5d-3af0-4aec-a1ff-80098d46f733 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.420416 Sep 11 08:48:47.747207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 119/237] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:47 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:47.751073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Returning 404 to user: Instance 8fe2eda9-45e2-4ce1-b1e3-313957f3d04a could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:48:47.755450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c4c10a9d-c35b-46c7-a396-9741a28fb5fb tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a" status: 404 len: 111 microversion: 2.1 time: 0.139361 Sep 11 08:48:47.761440 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 119/238] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:47 2022] GET /compute/v2.1/servers/8fe2eda9-45e2-4ce1-b1e3-313957f3d04a => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:48:48.017528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-370735189", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "networks": [{"uuid": "dc8de692-111e-4945-9712-7a5420c305ac"}]}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:48.100288 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] validate_networks() for [('dc8de692-111e-4945-9712-7a5420c305ac', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:48:48.791635 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-fbc3a059-be72-49d8-b80b-5bd1bcbcc5ed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:48.792619 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-fbc3a059-be72-49d8-b80b-5bd1bcbcc5ed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:48.799297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbc3a059-be72-49d8-b80b-5bd1bcbcc5ed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:48.799870 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbc3a059-be72-49d8-b80b-5bd1bcbcc5ed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:48.800242 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbc3a059-be72-49d8-b80b-5bd1bcbcc5ed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:48.800971 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbc3a059-be72-49d8-b80b-5bd1bcbcc5ed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:48.801393 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbc3a059-be72-49d8-b80b-5bd1bcbcc5ed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:48.801810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbc3a059-be72-49d8-b80b-5bd1bcbcc5ed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:49.022644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:48:49.023468 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:48:49.024040 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:48:49.024674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:48:49.025109 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:48:49.025913 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-fbc3a059-be72-49d8-b80b-5bd1bcbcc5ed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:49.036374 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-fbc3a059-be72-49d8-b80b-5bd1bcbcc5ed tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.249213 Sep 11 08:48:49.037902 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 120/239] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:48 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:49.050306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:49.050306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:49.050306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:49.050306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:49.051511 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:49.051511 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:49.060917 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:49.078266 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Getting quotas for project ead98e6e89d840a0b99273f28429b4ba. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:48:49.083445 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Getting quotas for user 0b198ff6ed104068b38b993054617f9a and project ead98e6e89d840a0b99273f28429b4ba. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:48:49.098398 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:48:49.102272 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:48:49.384136 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9283a273-cb65-494f-bb29-791a7a0bec60 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.369962 Sep 11 08:48:49.386658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 120/240] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 08:48:49.403286 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2e99ae9b-7051-48b8-8343-bb6da86a1d4b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:49.403924 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2e99ae9b-7051-48b8-8343-bb6da86a1d4b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:49.504389 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2e99ae9b-7051-48b8-8343-bb6da86a1d4b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:49.515553 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2e99ae9b-7051-48b8-8343-bb6da86a1d4b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1213 microversion: 2.1 time: 0.116033 Sep 11 08:48:49.516389 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 121/241] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:49 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1213 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:50.066941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-af346f4a-5fde-42a0-994f-35c6fce0ad53 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:50.066941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-af346f4a-5fde-42a0-994f-35c6fce0ad53 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:50.096635 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af346f4a-5fde-42a0-994f-35c6fce0ad53 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:50.097142 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af346f4a-5fde-42a0-994f-35c6fce0ad53 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:50.097584 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af346f4a-5fde-42a0-994f-35c6fce0ad53 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:50.098854 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af346f4a-5fde-42a0-994f-35c6fce0ad53 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:50.099376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af346f4a-5fde-42a0-994f-35c6fce0ad53 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:50.100318 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-af346f4a-5fde-42a0-994f-35c6fce0ad53 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:50.467071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-af346f4a-5fde-42a0-994f-35c6fce0ad53 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:50.475514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-af346f4a-5fde-42a0-994f-35c6fce0ad53 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.416776 Sep 11 08:48:50.476111 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 121/242] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:50 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:50.563340 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3f07b7b4-d566-4bed-9ad9-fe8dcb4d60fe tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:50.564590 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3f07b7b4-d566-4bed-9ad9-fe8dcb4d60fe tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:50.660949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3f07b7b4-d566-4bed-9ad9-fe8dcb4d60fe tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:50.780360 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2c2683ee-5c0c-4f6f-b856-8ff7a6229ba7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:50.781278 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2c2683ee-5c0c-4f6f-b856-8ff7a6229ba7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:50.791756 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2c2683ee-5c0c-4f6f-b856-8ff7a6229ba7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:50.791756 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2c2683ee-5c0c-4f6f-b856-8ff7a6229ba7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:50.791756 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2c2683ee-5c0c-4f6f-b856-8ff7a6229ba7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:50.792428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2c2683ee-5c0c-4f6f-b856-8ff7a6229ba7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:50.792893 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2c2683ee-5c0c-4f6f-b856-8ff7a6229ba7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:50.793326 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2c2683ee-5c0c-4f6f-b856-8ff7a6229ba7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:50.838939 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2c2683ee-5c0c-4f6f-b856-8ff7a6229ba7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/ips" status: 200 len: 151 microversion: 2.20 time: 0.062085 Sep 11 08:48:50.847782 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 122/243] 10.222.0.44 () {60 vars in 1289 bytes} [Sun Sep 11 08:48:50 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/ips => generated 151 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:48:50.913038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3f07b7b4-d566-4bed-9ad9-fe8dcb4d60fe tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1213 microversion: 2.1 time: 0.354033 Sep 11 08:48:50.914252 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 122/244] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:50 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1213 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:51.294005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f0cd2bac-6080-4272-bc80-91ac8826f467 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:51.298497 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f0cd2bac-6080-4272-bc80-91ac8826f467 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:51.309841 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd2bac-6080-4272-bc80-91ac8826f467 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:51.310937 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd2bac-6080-4272-bc80-91ac8826f467 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:51.311869 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd2bac-6080-4272-bc80-91ac8826f467 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:51.313176 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd2bac-6080-4272-bc80-91ac8826f467 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:51.314713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd2bac-6080-4272-bc80-91ac8826f467 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:51.315831 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd2bac-6080-4272-bc80-91ac8826f467 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:51.374404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f0cd2bac-6080-4272-bc80-91ac8826f467 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/ips" status: 200 len: 145 microversion: 2.1 time: 0.088716 Sep 11 08:48:51.375443 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 123/245] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 08:48:51 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/ips => generated 145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:48:51.501179 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8d61d24c-099e-40b1-8ec8-eaac277e1075 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:51.501800 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8d61d24c-099e-40b1-8ec8-eaac277e1075 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:51.506573 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=68 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:51.510739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d61d24c-099e-40b1-8ec8-eaac277e1075 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:51.510739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d61d24c-099e-40b1-8ec8-eaac277e1075 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:51.511096 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d61d24c-099e-40b1-8ec8-eaac277e1075 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:51.511925 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d61d24c-099e-40b1-8ec8-eaac277e1075 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:51.512375 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d61d24c-099e-40b1-8ec8-eaac277e1075 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:51.513016 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8d61d24c-099e-40b1-8ec8-eaac277e1075 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:51.709804 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8d61d24c-099e-40b1-8ec8-eaac277e1075 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:51.718258 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8d61d24c-099e-40b1-8ec8-eaac277e1075 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.221191 Sep 11 08:48:51.718838 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 123/246] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:51 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:51.938911 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8100270d-1d9d-48ef-8200-544c9a2644c1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:51.939472 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8100270d-1d9d-48ef-8200-544c9a2644c1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:51.947268 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8100270d-1d9d-48ef-8200-544c9a2644c1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:51.947772 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8100270d-1d9d-48ef-8200-544c9a2644c1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:51.948678 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8100270d-1d9d-48ef-8200-544c9a2644c1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:51.949398 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8100270d-1d9d-48ef-8200-544c9a2644c1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:51.949878 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8100270d-1d9d-48ef-8200-544c9a2644c1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:51.950334 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8100270d-1d9d-48ef-8200-544c9a2644c1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:52.026261 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8100270d-1d9d-48ef-8200-544c9a2644c1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:52.034517 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8100270d-1d9d-48ef-8200-544c9a2644c1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1217 microversion: 2.1 time: 0.099689 Sep 11 08:48:52.035118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 124/247] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:51 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:52.746869 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-dfa4f90b-96ea-415b-a119-7e6a2a1c336c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:52.746869 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-dfa4f90b-96ea-415b-a119-7e6a2a1c336c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:52.759397 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dfa4f90b-96ea-415b-a119-7e6a2a1c336c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:52.761588 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dfa4f90b-96ea-415b-a119-7e6a2a1c336c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:52.766400 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dfa4f90b-96ea-415b-a119-7e6a2a1c336c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:52.767341 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dfa4f90b-96ea-415b-a119-7e6a2a1c336c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:52.767929 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dfa4f90b-96ea-415b-a119-7e6a2a1c336c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:52.769584 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dfa4f90b-96ea-415b-a119-7e6a2a1c336c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:52.956877 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-dfa4f90b-96ea-415b-a119-7e6a2a1c336c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:52.977522 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-dfa4f90b-96ea-415b-a119-7e6a2a1c336c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.237679 Sep 11 08:48:52.978539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 124/248] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:52 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:53.061197 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-dca8c9ce-8e2d-4ab5-9c51-01a20fd46607 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:53.062288 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-dca8c9ce-8e2d-4ab5-9c51-01a20fd46607 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:53.066896 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:53.072079 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dca8c9ce-8e2d-4ab5-9c51-01a20fd46607 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:53.072727 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dca8c9ce-8e2d-4ab5-9c51-01a20fd46607 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:53.073478 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dca8c9ce-8e2d-4ab5-9c51-01a20fd46607 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:53.074487 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dca8c9ce-8e2d-4ab5-9c51-01a20fd46607 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:53.075469 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dca8c9ce-8e2d-4ab5-9c51-01a20fd46607 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:53.076116 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dca8c9ce-8e2d-4ab5-9c51-01a20fd46607 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:53.151807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-dca8c9ce-8e2d-4ab5-9c51-01a20fd46607 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:53.159964 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-dca8c9ce-8e2d-4ab5-9c51-01a20fd46607 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1209 microversion: 2.1 time: 0.104569 Sep 11 08:48:53.160554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 125/249] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:53 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:53.749718 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2af04455-be9c-4c52-98be-70c9cba2921d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Action: 'create', calling method: .version_select at 0x7fb27f158940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-437335689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmkh0vkkAc2mVFzwWTV2l3QDin0KAVEm/iMP4P/XkY9XgR9k1336ahPmNQAf652MizoGrDEyrvLmpEiEG4Ryxp/AtW3/KAwyCekwjPd8588vN2FewaHnctwQ5lGqMEzVQ=="}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:53.768848 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-2af04455-be9c-4c52-98be-70c9cba2921d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Getting quotas for project b4f426194c8d41bcaee7862c5d04b180. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:48:53.774494 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-2af04455-be9c-4c52-98be-70c9cba2921d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Getting quotas for user a0dde6aa81204252b66b6e640b343ac3 and project b4f426194c8d41bcaee7862c5d04b180. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:48:54.018732 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2af04455-be9c-4c52-98be-70c9cba2921d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.274063 Sep 11 08:48:54.022962 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-059fa398-1411-48bc-8866-7184708bd64a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:54.022962 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-059fa398-1411-48bc-8866-7184708bd64a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:54.027967 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-059fa398-1411-48bc-8866-7184708bd64a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:54.028464 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-059fa398-1411-48bc-8866-7184708bd64a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:54.028902 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-059fa398-1411-48bc-8866-7184708bd64a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:54.029614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-059fa398-1411-48bc-8866-7184708bd64a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:54.030073 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-059fa398-1411-48bc-8866-7184708bd64a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:54.030639 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-059fa398-1411-48bc-8866-7184708bd64a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:54.032061 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 125/250] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 08:48:53 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:48:54.187373 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-773981dc-00c2-4814-81bc-33f8e77d0c12 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:54.188256 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-773981dc-00c2-4814-81bc-33f8e77d0c12 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:54.207323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-773981dc-00c2-4814-81bc-33f8e77d0c12 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:54.207323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-773981dc-00c2-4814-81bc-33f8e77d0c12 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:54.207323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-773981dc-00c2-4814-81bc-33f8e77d0c12 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:54.207323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-773981dc-00c2-4814-81bc-33f8e77d0c12 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:54.208336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-773981dc-00c2-4814-81bc-33f8e77d0c12 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:54.208336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-773981dc-00c2-4814-81bc-33f8e77d0c12 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:54.284973 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-059fa398-1411-48bc-8866-7184708bd64a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:54.303345 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-059fa398-1411-48bc-8866-7184708bd64a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.290300 Sep 11 08:48:54.307117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-773981dc-00c2-4814-81bc-33f8e77d0c12 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:54.310637 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 126/251] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:54 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:54.316758 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-773981dc-00c2-4814-81bc-33f8e77d0c12 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1273 microversion: 2.1 time: 0.135228 Sep 11 08:48:54.317486 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 126/252] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:54 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:54.331364 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1077566150", "imageRef": "d55f88b4-d1e8-43eb-b510-364c99666ba8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-437335689", "networks": [{"uuid": "3256f2fc-d18a-42fd-b821-af5297968c06"}]}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:54.409381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] validate_networks() for [('3256f2fc-d18a-42fd-b821-af5297968c06', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:48:54.498712 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0ec0315e-a24f-470f-925b-25ea2cf9a178 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:54.499780 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0ec0315e-a24f-470f-925b-25ea2cf9a178 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:54.516024 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0ec0315e-a24f-470f-925b-25ea2cf9a178 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:54.516519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0ec0315e-a24f-470f-925b-25ea2cf9a178 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:54.517064 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0ec0315e-a24f-470f-925b-25ea2cf9a178 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:54.517788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0ec0315e-a24f-470f-925b-25ea2cf9a178 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:54.518304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0ec0315e-a24f-470f-925b-25ea2cf9a178 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:54.518708 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0ec0315e-a24f-470f-925b-25ea2cf9a178 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:54.547877 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-0ec0315e-a24f-470f-925b-25ea2cf9a178 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lazy-loading 'flavor' on Instance uuid 223e4b7b-8a6c-4647-aa91-aae73dbeb340 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:48:55.358437 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0ec0315e-a24f-470f-925b-25ea2cf9a178 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "POST /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/action" status: 202 len: 0 microversion: 2.20 time: 0.874057 Sep 11 08:48:55.363131 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 127/253] 10.222.0.44 () {62 vars in 1319 bytes} [Sun Sep 11 08:48:54 2022] POST /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/action => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:48:55.371619 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e88ad2bb-c01f-4379-b21b-9ee72d099033 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:55.372634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e88ad2bb-c01f-4379-b21b-9ee72d099033 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:55.382067 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e88ad2bb-c01f-4379-b21b-9ee72d099033 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:55.383184 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e88ad2bb-c01f-4379-b21b-9ee72d099033 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:55.383898 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e88ad2bb-c01f-4379-b21b-9ee72d099033 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:55.385086 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e88ad2bb-c01f-4379-b21b-9ee72d099033 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:55.385749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e88ad2bb-c01f-4379-b21b-9ee72d099033 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:55.389575 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e88ad2bb-c01f-4379-b21b-9ee72d099033 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:55.407608 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:48:55.417069 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:48:55.417578 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:48:55.418781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:48:55.419510 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:48:55.420628 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:48:55.435227 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:55.435907 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:55.436856 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:55.437800 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:55.438500 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:55.439052 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:55.465738 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Getting quotas for project b4f426194c8d41bcaee7862c5d04b180. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:48:55.470638 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Getting quotas for user a0dde6aa81204252b66b6e640b343ac3 and project b4f426194c8d41bcaee7862c5d04b180. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:48:55.486108 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:48:55.488384 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d55f88b4-d1e8-43eb-b510-364c99666ba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:48:55.579740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e88ad2bb-c01f-4379-b21b-9ee72d099033 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:55.591365 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e88ad2bb-c01f-4379-b21b-9ee72d099033 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.226413 Sep 11 08:48:55.591969 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 128/254] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:55 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:55.597129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2e9e140c-013f-46bb-939a-bf5f59af3434 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:55.597961 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2e9e140c-013f-46bb-939a-bf5f59af3434 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:55.610602 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2e9e140c-013f-46bb-939a-bf5f59af3434 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:55.611328 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2e9e140c-013f-46bb-939a-bf5f59af3434 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:55.611937 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2e9e140c-013f-46bb-939a-bf5f59af3434 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:55.612847 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2e9e140c-013f-46bb-939a-bf5f59af3434 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:55.613491 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2e9e140c-013f-46bb-939a-bf5f59af3434 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:55.613919 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2e9e140c-013f-46bb-939a-bf5f59af3434 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:55.749093 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a0769c6d-feaa-4ae3-9800-d6c33ccd087b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436705 Sep 11 08:48:55.751150 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 127/255] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:48:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:48:55.762019 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:55.763055 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:55.773140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:55.773677 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:55.774512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:55.775342 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:55.775815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:55.776303 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:55.791433 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2e9e140c-013f-46bb-939a-bf5f59af3434 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:55.797202 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2e9e140c-013f-46bb-939a-bf5f59af3434 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1313 microversion: 2.1 time: 0.203736 Sep 11 08:48:55.806185 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 129/256] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:55 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:55.808658 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1598ee86-f6a9-4955-819a-cb7df0220453 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:55.810074 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1598ee86-f6a9-4955-819a-cb7df0220453 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:55.907118 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1598ee86-f6a9-4955-819a-cb7df0220453 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:55.926881 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1598ee86-f6a9-4955-819a-cb7df0220453 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1258 microversion: 2.1 time: 0.115724 Sep 11 08:48:55.926881 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 130/257] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:55 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1258 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:55.935202 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-45e1dc40-a795-4f57-a6df-cd31761bb8b1 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c770e94-020f-40b1-8abb-a4684f07254d"}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:55.938135 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-45e1dc40-a795-4f57-a6df-cd31761bb8b1 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:55.955120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-45e1dc40-a795-4f57-a6df-cd31761bb8b1 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:55.955646 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-45e1dc40-a795-4f57-a6df-cd31761bb8b1 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:55.957163 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-45e1dc40-a795-4f57-a6df-cd31761bb8b1 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:55.957783 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-45e1dc40-a795-4f57-a6df-cd31761bb8b1 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:55.964088 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-45e1dc40-a795-4f57-a6df-cd31761bb8b1 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:55.964781 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-45e1dc40-a795-4f57-a6df-cd31761bb8b1 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:56.074114 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:56.083208 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:56.086887 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:56.086887 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e44bb0b5-61d6-4f1a-83a7-02d8377081e0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.334212 Sep 11 08:48:56.087724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 128/258] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:48:55 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:48:56.632962 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-293c0347-55d9-4df5-96d3-687b14029806 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:56.633659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-293c0347-55d9-4df5-96d3-687b14029806 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:56.657993 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-293c0347-55d9-4df5-96d3-687b14029806 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:56.659811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-293c0347-55d9-4df5-96d3-687b14029806 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:56.659811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-293c0347-55d9-4df5-96d3-687b14029806 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:56.664351 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-293c0347-55d9-4df5-96d3-687b14029806 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:56.664351 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-293c0347-55d9-4df5-96d3-687b14029806 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:56.664351 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-293c0347-55d9-4df5-96d3-687b14029806 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:56.897665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-293c0347-55d9-4df5-96d3-687b14029806 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:56.906587 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-293c0347-55d9-4df5-96d3-687b14029806 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.278035 Sep 11 08:48:56.907184 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 129/259] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:56 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:56.912868 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fd59e2a4-0979-4c21-b5a1-26f7daeb7c45 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:56.913760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-fd59e2a4-0979-4c21-b5a1-26f7daeb7c45 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:56.921249 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fd59e2a4-0979-4c21-b5a1-26f7daeb7c45 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:56.922121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fd59e2a4-0979-4c21-b5a1-26f7daeb7c45 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:56.924742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fd59e2a4-0979-4c21-b5a1-26f7daeb7c45 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:56.924742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fd59e2a4-0979-4c21-b5a1-26f7daeb7c45 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:56.924742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fd59e2a4-0979-4c21-b5a1-26f7daeb7c45 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:56.924742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fd59e2a4-0979-4c21-b5a1-26f7daeb7c45 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:57.204332 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fd59e2a4-0979-4c21-b5a1-26f7daeb7c45 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:57.215315 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-fd59e2a4-0979-4c21-b5a1-26f7daeb7c45 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1313 microversion: 2.1 time: 0.306182 Sep 11 08:48:57.216563 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 130/260] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:56 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:57.221946 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9fe2446a-ffc9-4a29-94b7-eb5ad2e26194 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:57.226357 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9fe2446a-ffc9-4a29-94b7-eb5ad2e26194 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:57.372045 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9fe2446a-ffc9-4a29-94b7-eb5ad2e26194 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:57.388523 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9fe2446a-ffc9-4a29-94b7-eb5ad2e26194 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1258 microversion: 2.1 time: 0.169909 Sep 11 08:48:57.389954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 131/261] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:57 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:57.399432 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:57.400862 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:57.434067 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-45e1dc40-a795-4f57-a6df-cd31761bb8b1 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "POST /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.500872 Sep 11 08:48:57.434067 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 131/262] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:48:55 2022] POST /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/os-volume_attachments => generated 194 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:48:57.435742 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-62c62eb5-4ac0-4cea-9606-2272a56e7c25 req-0d1e8906-ae59-48fe-9f46-577aa98699b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2432dc-8be1-4efd-8315-9c9e07a60050", "tag": "2402bdec-75a8-4343-930a-de5d274eaaab"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:48:57.437599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:57.438644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:57.439511 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:57.440676 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:57.441478 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:57.451143 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:57.453425 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-62c62eb5-4ac0-4cea-9606-2272a56e7c25 req-0d1e8906-ae59-48fe-9f46-577aa98699b6 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:57.453910 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-62c62eb5-4ac0-4cea-9606-2272a56e7c25 req-0d1e8906-ae59-48fe-9f46-577aa98699b6 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:57.454583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-62c62eb5-4ac0-4cea-9606-2272a56e7c25 req-0d1e8906-ae59-48fe-9f46-577aa98699b6 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:57.470859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-62c62eb5-4ac0-4cea-9606-2272a56e7c25 req-0d1e8906-ae59-48fe-9f46-577aa98699b6 service nova] Creating event network-changed:2402bdec-75a8-4343-930a-de5d274eaaab for instance 4d2432dc-8be1-4efd-8315-9c9e07a60050 on hv-cinder-85694 Sep 11 08:48:57.479566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-62c62eb5-4ac0-4cea-9606-2272a56e7c25 req-0d1e8906-ae59-48fe-9f46-577aa98699b6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053300 Sep 11 08:48:57.485111 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 132/263] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:48:57.738185 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:57.747984 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:57.749509 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:57.750911 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9aa2e736-f5bd-480e-bcc4-05a6479f2623 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.359646 Sep 11 08:48:57.751747 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 132/264] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:48:57 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:48:57.944775 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4e453567-39e2-41e0-9c7f-318b886abbeb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:57.946114 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4e453567-39e2-41e0-9c7f-318b886abbeb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:57.953602 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e453567-39e2-41e0-9c7f-318b886abbeb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:57.954653 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e453567-39e2-41e0-9c7f-318b886abbeb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:57.955176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e453567-39e2-41e0-9c7f-318b886abbeb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:57.956035 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e453567-39e2-41e0-9c7f-318b886abbeb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:57.956733 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e453567-39e2-41e0-9c7f-318b886abbeb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:57.957233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e453567-39e2-41e0-9c7f-318b886abbeb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:58.241582 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5323c3e4-26f4-4340-9776-abecf9cf15da tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:58.242249 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5323c3e4-26f4-4340-9776-abecf9cf15da tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:58.263710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5323c3e4-26f4-4340-9776-abecf9cf15da tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:58.263710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5323c3e4-26f4-4340-9776-abecf9cf15da tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:58.263710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5323c3e4-26f4-4340-9776-abecf9cf15da tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:58.270299 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5323c3e4-26f4-4340-9776-abecf9cf15da tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:58.270944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5323c3e4-26f4-4340-9776-abecf9cf15da tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:58.271771 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5323c3e4-26f4-4340-9776-abecf9cf15da tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:58.409910 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4e453567-39e2-41e0-9c7f-318b886abbeb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:58.420472 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4e453567-39e2-41e0-9c7f-318b886abbeb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.481120 Sep 11 08:48:58.421062 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 133/265] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:57 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:58.440884 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e03763ca-6fed-4321-b37e-dfa4b832d276 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:58.442617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e03763ca-6fed-4321-b37e-dfa4b832d276 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:58.450138 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e03763ca-6fed-4321-b37e-dfa4b832d276 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:58.450959 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e03763ca-6fed-4321-b37e-dfa4b832d276 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:58.451400 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e03763ca-6fed-4321-b37e-dfa4b832d276 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:58.452154 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e03763ca-6fed-4321-b37e-dfa4b832d276 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:58.452572 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e03763ca-6fed-4321-b37e-dfa4b832d276 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:58.452999 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e03763ca-6fed-4321-b37e-dfa4b832d276 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:58.524917 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e03763ca-6fed-4321-b37e-dfa4b832d276 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:58.534835 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e03763ca-6fed-4321-b37e-dfa4b832d276 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1254 microversion: 2.1 time: 0.111347 Sep 11 08:48:58.535501 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 134/266] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:58 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1254 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:58.557551 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5323c3e4-26f4-4340-9776-abecf9cf15da tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:58.573840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5323c3e4-26f4-4340-9776-abecf9cf15da tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1313 microversion: 2.1 time: 0.333269 Sep 11 08:48:58.586783 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 133/267] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:58 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:58.777782 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:58.778781 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:58.788887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:58.788887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:58.788887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:58.789945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:58.791214 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:58.800054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:59.066433 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:59.076779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:59.079009 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:59.080879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-00e1245a-a194-4824-bfb0-23a5bce00bb8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.307186 Sep 11 08:48:59.094406 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 135/268] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:48:58 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:48:59.450614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3f33e840-5eaa-46b4-a78d-5f3699b5808c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:59.451769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3f33e840-5eaa-46b4-a78d-5f3699b5808c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:59.466571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3f33e840-5eaa-46b4-a78d-5f3699b5808c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:59.467437 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3f33e840-5eaa-46b4-a78d-5f3699b5808c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:59.468227 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3f33e840-5eaa-46b4-a78d-5f3699b5808c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:59.469507 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3f33e840-5eaa-46b4-a78d-5f3699b5808c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:59.470378 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3f33e840-5eaa-46b4-a78d-5f3699b5808c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:59.472341 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3f33e840-5eaa-46b4-a78d-5f3699b5808c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:59.585429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-979201c3-0346-4bc6-b053-9ae113f6115e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:59.587218 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-979201c3-0346-4bc6-b053-9ae113f6115e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:59.595876 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-979201c3-0346-4bc6-b053-9ae113f6115e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:59.597432 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-979201c3-0346-4bc6-b053-9ae113f6115e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:59.599772 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-979201c3-0346-4bc6-b053-9ae113f6115e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:59.604224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-979201c3-0346-4bc6-b053-9ae113f6115e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:59.604224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-979201c3-0346-4bc6-b053-9ae113f6115e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:59.604224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-979201c3-0346-4bc6-b053-9ae113f6115e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:59.713589 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-979201c3-0346-4bc6-b053-9ae113f6115e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:59.723110 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-979201c3-0346-4bc6-b053-9ae113f6115e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1310 microversion: 2.1 time: 0.142643 Sep 11 08:48:59.724141 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 136/269] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:59 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1310 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:48:59.729289 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-21ccffad-c4b7-4254-b958-e68cb4eb1b69 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:48:59.732844 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-21ccffad-c4b7-4254-b958-e68cb4eb1b69 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:48:59.736821 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21ccffad-c4b7-4254-b958-e68cb4eb1b69 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:59.737364 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21ccffad-c4b7-4254-b958-e68cb4eb1b69 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:59.738003 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21ccffad-c4b7-4254-b958-e68cb4eb1b69 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:59.738743 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21ccffad-c4b7-4254-b958-e68cb4eb1b69 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:48:59.739243 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21ccffad-c4b7-4254-b958-e68cb4eb1b69 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:48:59.739845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21ccffad-c4b7-4254-b958-e68cb4eb1b69 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:48:59.886027 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3f33e840-5eaa-46b4-a78d-5f3699b5808c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:59.896963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3f33e840-5eaa-46b4-a78d-5f3699b5808c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.454697 Sep 11 08:48:59.898033 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 134/270] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:59 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:48:59.945000 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-21ccffad-c4b7-4254-b958-e68cb4eb1b69 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:48:59.953663 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-21ccffad-c4b7-4254-b958-e68cb4eb1b69 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1313 microversion: 2.1 time: 0.228424 Sep 11 08:48:59.954245 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 137/271] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:48:59 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:00.109264 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:00.113631 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:00.119694 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:00.120185 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:00.121004 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:00.122558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:00.123044 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:00.123639 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:00.316479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:00.332941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:00.337539 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:00.340717 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-323eaed5-28dd-47dc-bc40-d2d6249f134e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.235180 Sep 11 08:49:00.341791 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 135/272] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:00 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:00.753843 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9abdd543-a151-4c02-bf9b-4430e9726354 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:00.755000 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9abdd543-a151-4c02-bf9b-4430e9726354 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:00.786072 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9abdd543-a151-4c02-bf9b-4430e9726354 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:00.789795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9abdd543-a151-4c02-bf9b-4430e9726354 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:00.790631 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9abdd543-a151-4c02-bf9b-4430e9726354 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:00.795247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9abdd543-a151-4c02-bf9b-4430e9726354 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:00.796849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9abdd543-a151-4c02-bf9b-4430e9726354 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:00.799713 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9abdd543-a151-4c02-bf9b-4430e9726354 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:00.920143 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-9abdd543-a151-4c02-bf9b-4430e9726354 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:00.928770 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-63bc214d-3564-4854-8bba-f86128f7924e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:00.929370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9abdd543-a151-4c02-bf9b-4430e9726354 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1318 microversion: 2.1 time: 0.183984 Sep 11 08:49:00.929456 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-63bc214d-3564-4854-8bba-f86128f7924e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:00.929945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 138/273] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:00 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:00.936086 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63bc214d-3564-4854-8bba-f86128f7924e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:00.936598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63bc214d-3564-4854-8bba-f86128f7924e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:00.937406 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63bc214d-3564-4854-8bba-f86128f7924e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:00.938165 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63bc214d-3564-4854-8bba-f86128f7924e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:00.938628 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63bc214d-3564-4854-8bba-f86128f7924e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:00.939055 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63bc214d-3564-4854-8bba-f86128f7924e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:00.978263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-30a50cd1-372e-4be1-80df-6645fbfda277 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:00.978881 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-30a50cd1-372e-4be1-80df-6645fbfda277 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:00.985949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30a50cd1-372e-4be1-80df-6645fbfda277 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:00.986482 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30a50cd1-372e-4be1-80df-6645fbfda277 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:00.986921 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30a50cd1-372e-4be1-80df-6645fbfda277 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:00.987721 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30a50cd1-372e-4be1-80df-6645fbfda277 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:00.988173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30a50cd1-372e-4be1-80df-6645fbfda277 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:00.988594 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30a50cd1-372e-4be1-80df-6645fbfda277 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:01.367612 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-30a50cd1-372e-4be1-80df-6645fbfda277 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:01.385263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-30a50cd1-372e-4be1-80df-6645fbfda277 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1313 microversion: 2.1 time: 0.411268 Sep 11 08:49:01.392616 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-63bc214d-3564-4854-8bba-f86128f7924e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:01.405765 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 139/274] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:00 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:01.418584 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:01.430966 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:01.437240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-63bc214d-3564-4854-8bba-f86128f7924e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.512662 Sep 11 08:49:01.439165 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 136/275] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:00 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:01.451154 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:01.451154 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:01.451154 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:01.451154 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:01.451701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:01.451701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:01.663619 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:01.675127 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:01.676702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:01.678013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-72fba95c-3537-4993-b93d-fbc87717f2ad tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.270920 Sep 11 08:49:01.678688 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 140/276] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:01 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:01.972533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-89e015a3-6f80-424c-bba3-d22c8aed5948 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:01.974789 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-89e015a3-6f80-424c-bba3-d22c8aed5948 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:01.991749 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89e015a3-6f80-424c-bba3-d22c8aed5948 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:01.992608 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89e015a3-6f80-424c-bba3-d22c8aed5948 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:01.993293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89e015a3-6f80-424c-bba3-d22c8aed5948 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:01.994494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89e015a3-6f80-424c-bba3-d22c8aed5948 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:01.995137 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89e015a3-6f80-424c-bba3-d22c8aed5948 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:01.997304 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89e015a3-6f80-424c-bba3-d22c8aed5948 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:02.165976 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-89e015a3-6f80-424c-bba3-d22c8aed5948 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:02.174723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-89e015a3-6f80-424c-bba3-d22c8aed5948 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1328 microversion: 2.1 time: 0.206875 Sep 11 08:49:02.175416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 137/277] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:01 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1328 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:02.423595 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-806d3d11-6254-4016-93ca-20b3287f1216 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:02.424614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-806d3d11-6254-4016-93ca-20b3287f1216 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:02.436521 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-806d3d11-6254-4016-93ca-20b3287f1216 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:02.437018 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-806d3d11-6254-4016-93ca-20b3287f1216 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:02.437451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-806d3d11-6254-4016-93ca-20b3287f1216 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:02.438188 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-806d3d11-6254-4016-93ca-20b3287f1216 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:02.438649 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-806d3d11-6254-4016-93ca-20b3287f1216 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:02.439105 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-806d3d11-6254-4016-93ca-20b3287f1216 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:02.497889 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6213b776-da6c-411c-9769-320edbc8c8cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:02.499000 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6213b776-da6c-411c-9769-320edbc8c8cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:02.518317 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6213b776-da6c-411c-9769-320edbc8c8cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:02.531626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6213b776-da6c-411c-9769-320edbc8c8cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:02.531626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6213b776-da6c-411c-9769-320edbc8c8cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:02.531626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6213b776-da6c-411c-9769-320edbc8c8cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:02.531626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6213b776-da6c-411c-9769-320edbc8c8cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:02.532086 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6213b776-da6c-411c-9769-320edbc8c8cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:02.760598 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-806d3d11-6254-4016-93ca-20b3287f1216 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:02.772862 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-806d3d11-6254-4016-93ca-20b3287f1216 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1313 microversion: 2.1 time: 0.358426 Sep 11 08:49:02.774115 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 141/278] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:02 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:02.783549 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:02.784396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:02.795228 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:02.796309 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:02.796898 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:02.798477 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:02.799225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:02.799817 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:02.946064 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6213b776-da6c-411c-9769-320edbc8c8cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:02.958712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6213b776-da6c-411c-9769-320edbc8c8cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.467591 Sep 11 08:49:02.962196 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 138/279] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:02 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:03.034487 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:03.048420 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:03.052726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:03.054321 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b0a01bd7-07a1-45ff-b591-9faafb339cbc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.278641 Sep 11 08:49:03.055316 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 142/280] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:02 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:03.220869 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2acf7a69-a0fd-488a-bf08-b94a1dedd29b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:03.226180 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2acf7a69-a0fd-488a-bf08-b94a1dedd29b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:03.229279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-799f8ff1-a6ff-4fb7-96bc-a1f6ea4929e4 req-3070b923-fe5f-4038-9d73-4fab8a1cf736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2432dc-8be1-4efd-8315-9c9e07a60050", "name": "network-vif-plugged", "status": "completed", "tag": "2402bdec-75a8-4343-930a-de5d274eaaab"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:03.240314 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-799f8ff1-a6ff-4fb7-96bc-a1f6ea4929e4 req-3070b923-fe5f-4038-9d73-4fab8a1cf736 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:03.240785 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-799f8ff1-a6ff-4fb7-96bc-a1f6ea4929e4 req-3070b923-fe5f-4038-9d73-4fab8a1cf736 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:03.241393 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-799f8ff1-a6ff-4fb7-96bc-a1f6ea4929e4 req-3070b923-fe5f-4038-9d73-4fab8a1cf736 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:03.242904 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2acf7a69-a0fd-488a-bf08-b94a1dedd29b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:03.243801 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2acf7a69-a0fd-488a-bf08-b94a1dedd29b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:03.246816 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2acf7a69-a0fd-488a-bf08-b94a1dedd29b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:03.246816 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2acf7a69-a0fd-488a-bf08-b94a1dedd29b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:03.246816 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2acf7a69-a0fd-488a-bf08-b94a1dedd29b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:03.247558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2acf7a69-a0fd-488a-bf08-b94a1dedd29b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:03.256999 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-799f8ff1-a6ff-4fb7-96bc-a1f6ea4929e4 req-3070b923-fe5f-4038-9d73-4fab8a1cf736 service nova] Creating event network-vif-plugged:2402bdec-75a8-4343-930a-de5d274eaaab for instance 4d2432dc-8be1-4efd-8315-9c9e07a60050 on hv-cinder-85694 Sep 11 08:49:03.262822 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-799f8ff1-a6ff-4fb7-96bc-a1f6ea4929e4 req-3070b923-fe5f-4038-9d73-4fab8a1cf736 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037273 Sep 11 08:49:03.263777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 143/281] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:49:03.331249 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2acf7a69-a0fd-488a-bf08-b94a1dedd29b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:03.336987 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:03.345248 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2acf7a69-a0fd-488a-bf08-b94a1dedd29b tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1316 microversion: 2.1 time: 0.148814 Sep 11 08:49:03.351521 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 139/282] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:03 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:03.816657 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5d335c19-3f23-4878-8bac-5b21ae825f75 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:03.817393 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5d335c19-3f23-4878-8bac-5b21ae825f75 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:03.824727 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d335c19-3f23-4878-8bac-5b21ae825f75 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:03.825404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d335c19-3f23-4878-8bac-5b21ae825f75 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:03.825922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d335c19-3f23-4878-8bac-5b21ae825f75 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:03.826757 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d335c19-3f23-4878-8bac-5b21ae825f75 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:03.827273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d335c19-3f23-4878-8bac-5b21ae825f75 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:03.827760 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d335c19-3f23-4878-8bac-5b21ae825f75 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:04.004011 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5fb9c6bf-bb95-4c64-ab20-9ca938ca9325 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:04.004567 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5fb9c6bf-bb95-4c64-ab20-9ca938ca9325 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:04.015908 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5fb9c6bf-bb95-4c64-ab20-9ca938ca9325 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:04.016954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5fb9c6bf-bb95-4c64-ab20-9ca938ca9325 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:04.017592 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5fb9c6bf-bb95-4c64-ab20-9ca938ca9325 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:04.019430 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5fb9c6bf-bb95-4c64-ab20-9ca938ca9325 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:04.021373 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5fb9c6bf-bb95-4c64-ab20-9ca938ca9325 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:04.022103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5fb9c6bf-bb95-4c64-ab20-9ca938ca9325 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:04.131353 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5d335c19-3f23-4878-8bac-5b21ae825f75 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:04.147506 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5d335c19-3f23-4878-8bac-5b21ae825f75 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1313 microversion: 2.1 time: 0.336699 Sep 11 08:49:04.148342 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 144/283] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:03 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:04.156304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:04.164830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:04.187118 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:04.195713 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:04.196674 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:04.198390 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:04.200696 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:04.201304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:04.381361 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5fb9c6bf-bb95-4c64-ab20-9ca938ca9325 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:04.399684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5fb9c6bf-bb95-4c64-ab20-9ca938ca9325 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1500 microversion: 2.1 time: 0.400507 Sep 11 08:49:04.413369 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 140/284] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:03 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1500 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:04.425268 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-643172554", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:04.505958 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] validate_networks() for None {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:49:04.597777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:04.600649 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:04.609968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:04.615909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:04.635304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ce86595e-05e9-4a61-be62-4c5d36fcc691 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.467896 Sep 11 08:49:04.635304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 145/285] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:04 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:04.636755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2f4f1ea8-35b5-439a-8ef5-f7f673dcd324 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:04.637499 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2f4f1ea8-35b5-439a-8ef5-f7f673dcd324 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:04.659719 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f4f1ea8-35b5-439a-8ef5-f7f673dcd324 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:04.660211 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f4f1ea8-35b5-439a-8ef5-f7f673dcd324 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:04.660647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f4f1ea8-35b5-439a-8ef5-f7f673dcd324 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:04.661921 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f4f1ea8-35b5-439a-8ef5-f7f673dcd324 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:04.669430 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f4f1ea8-35b5-439a-8ef5-f7f673dcd324 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:04.669634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f4f1ea8-35b5-439a-8ef5-f7f673dcd324 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:04.918869 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2f4f1ea8-35b5-439a-8ef5-f7f673dcd324 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:04.933076 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2f4f1ea8-35b5-439a-8ef5-f7f673dcd324 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.313235 Sep 11 08:49:04.934348 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 146/286] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:04 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:04.940692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52d30f28-8f69-407b-bba1-610894cc5f84"}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:04.944072 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:04.951283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:04.952146 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:04.952788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:04.953977 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:04.954825 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:04.955591 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:04.987845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] HTTP exception thrown: Cannot 'attach_volume' instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 while it is in vm_state rescued Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Request method failure captured: Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: POST /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184/os-volume_attachments HTTP/1.1 Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 74 Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaCAu486B1xOWjzoN32Ui9eEOSqsCt3PPO76qh3QezPV599Kfd26fIVevOl2XWy4ljtSLDXXhbgXhEByiOZUCykRIKveORgcox18nSEtMQfNksuGMDm5LQpWcCuCK28TkehgbbHx8cYJignj8hbMDx_f29oWsYlEYPPugfePpJOGrDM Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: bcb554b6cf504ca9a30a1ea871364e3d Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:49:04.990247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bcb554b6cf504ca9a30a1ea871364e3d", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: bcb554b6cf504ca9a30a1ea871364e3d Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-ServerRescueNegativeTestJSON-1061498163-project Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 2aea4a0e0ec74c538735b890fb774b14 Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1061498163-project Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {"volumeAttachment": {"volumeId": "52d30f28-8f69-407b-bba1-610894cc5f84"}} Sep 11 08:49:04.991990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Cannot 'attach_volume' instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 while it is in vm_state rescued Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'server_id': '9bbdc2f9-9111-44ca-b51e-5af1c6069184', 'body': {'volumeAttachment': {'volumeId': '52d30f28-8f69-407b-bba1-610894cc5f84'}}} Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:49:04.992769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 while it is in vm_state rescued Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:49:04.994722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:49:04.996980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:49:04.996980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:49:04.996980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 while it is in vm_state rescued Sep 11 08:49:04.996980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:49:04.996980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Returning 409 to user: Cannot 'attach_volume' instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 while it is in vm_state rescued {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:49:04.996980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ec4767d8-d58c-401b-81f0-8a2c914ff304 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "POST /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056641 Sep 11 08:49:04.996980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 147/287] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:49:04 2022] POST /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 11 08:49:05.005946 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4dd26916-e040-48ba-b3db-c5fde307b9fa tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:05.006922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4dd26916-e040-48ba-b3db-c5fde307b9fa tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:05.015656 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4dd26916-e040-48ba-b3db-c5fde307b9fa tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:05.016594 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4dd26916-e040-48ba-b3db-c5fde307b9fa tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:05.017213 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4dd26916-e040-48ba-b3db-c5fde307b9fa tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:05.018043 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4dd26916-e040-48ba-b3db-c5fde307b9fa tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:05.018642 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4dd26916-e040-48ba-b3db-c5fde307b9fa tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:05.019144 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4dd26916-e040-48ba-b3db-c5fde307b9fa tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:05.121605 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:49:05.122392 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:49:05.123227 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:49:05.123933 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:49:05.124656 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:49:05.162648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:05.163547 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:05.164277 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:05.165226 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:05.166374 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:05.167346 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:05.233574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Getting quotas for project baaaaf5f58244280b0e265aa43bc571b. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:49:05.245408 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Getting quotas for user 7c2338046a594f9eb4f2fef030f1b82b and project baaaaf5f58244280b0e265aa43bc571b. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:49:05.261911 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:49:05.264366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:49:05.332692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4dd26916-e040-48ba-b3db-c5fde307b9fa tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "POST /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184/action" status: 202 len: 0 microversion: 2.1 time: 0.331633 Sep 11 08:49:05.337341 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 148/288] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:49:04 2022] POST /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:49:05.365323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-aaa1f45f-b4da-4a1c-adb1-9c7091ff12bc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:05.373693 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-aaa1f45f-b4da-4a1c-adb1-9c7091ff12bc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:05.421502 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aaa1f45f-b4da-4a1c-adb1-9c7091ff12bc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:05.422523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aaa1f45f-b4da-4a1c-adb1-9c7091ff12bc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:05.423407 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aaa1f45f-b4da-4a1c-adb1-9c7091ff12bc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:05.425016 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aaa1f45f-b4da-4a1c-adb1-9c7091ff12bc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:05.426288 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aaa1f45f-b4da-4a1c-adb1-9c7091ff12bc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:05.434959 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aaa1f45f-b4da-4a1c-adb1-9c7091ff12bc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:05.448219 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d9b5bb41-4357-4d4b-9deb-ef31105a9b99 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.033672 Sep 11 08:49:05.449881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 141/289] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:49:05.463496 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-52d4802b-9116-424f-8fb9-dfa4a1b3b7d4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:05.464336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-52d4802b-9116-424f-8fb9-dfa4a1b3b7d4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:05.476325 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52d4802b-9116-424f-8fb9-dfa4a1b3b7d4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:05.477060 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52d4802b-9116-424f-8fb9-dfa4a1b3b7d4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:05.477678 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52d4802b-9116-424f-8fb9-dfa4a1b3b7d4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:05.478562 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52d4802b-9116-424f-8fb9-dfa4a1b3b7d4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:05.481262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52d4802b-9116-424f-8fb9-dfa4a1b3b7d4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:05.482869 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52d4802b-9116-424f-8fb9-dfa4a1b3b7d4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:05.799000 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-aaa1f45f-b4da-4a1c-adb1-9c7091ff12bc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:05.812151 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-aaa1f45f-b4da-4a1c-adb1-9c7091ff12bc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1313 microversion: 2.1 time: 0.466458 Sep 11 08:49:05.814039 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 149/290] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:05 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:05.837462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-af7098f5-08de-45ad-b699-7728074807ba tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:05.837462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-af7098f5-08de-45ad-b699-7728074807ba tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:05.916093 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=10 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:06.026361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-af7098f5-08de-45ad-b699-7728074807ba tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:06.033298 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-52d4802b-9116-424f-8fb9-dfa4a1b3b7d4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:06.034944 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-af7098f5-08de-45ad-b699-7728074807ba tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1214 microversion: 2.1 time: 0.219518 Sep 11 08:49:06.035762 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 150/291] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:05 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:06.044160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:06.045135 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:06.055796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-52d4802b-9116-424f-8fb9-dfa4a1b3b7d4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.596126 Sep 11 08:49:06.056763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:06.056998 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 142/292] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:05 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:06.057275 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:06.059572 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:06.060338 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:06.060814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:06.061255 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:06.089475 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-30939c93-9d3b-4a62-9cb3-fdbe894957d0 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:06.091489 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-30939c93-9d3b-4a62-9cb3-fdbe894957d0 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:06.124969 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-30939c93-9d3b-4a62-9cb3-fdbe894957d0 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:06.136075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-30939c93-9d3b-4a62-9cb3-fdbe894957d0 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:06.136075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-30939c93-9d3b-4a62-9cb3-fdbe894957d0 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:06.136075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-30939c93-9d3b-4a62-9cb3-fdbe894957d0 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:06.136075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-30939c93-9d3b-4a62-9cb3-fdbe894957d0 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:06.136760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-30939c93-9d3b-4a62-9cb3-fdbe894957d0 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:06.451477 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-30939c93-9d3b-4a62-9cb3-fdbe894957d0 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:06.477635 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:06.477802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-30939c93-9d3b-4a62-9cb3-fdbe894957d0 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.416995 Sep 11 08:49:06.477802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 143/293] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:06 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:06.495923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-d79baccb-5e26-41c4-a7bb-e2d0139b398f req-8b4effec-d795-4a9c-b6b7-07534540a0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2520cc9-8413-40ef-9b12-b5914bff16e2", "tag": "fa04f10d-c16c-4338-8893-20b0b4de7866"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:06.498740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:06.501414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:06.503127 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-60b9125e-29c0-48d2-940f-fdb022f52edb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.466154 Sep 11 08:49:06.504235 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 151/294] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:06 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:06.517682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d79baccb-5e26-41c4-a7bb-e2d0139b398f req-8b4effec-d795-4a9c-b6b7-07534540a0a8 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:06.528202 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d79baccb-5e26-41c4-a7bb-e2d0139b398f req-8b4effec-d795-4a9c-b6b7-07534540a0a8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:06.529111 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d79baccb-5e26-41c4-a7bb-e2d0139b398f req-8b4effec-d795-4a9c-b6b7-07534540a0a8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:06.570949 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-d79baccb-5e26-41c4-a7bb-e2d0139b398f req-8b4effec-d795-4a9c-b6b7-07534540a0a8 service nova] Creating event network-changed:fa04f10d-c16c-4338-8893-20b0b4de7866 for instance a2520cc9-8413-40ef-9b12-b5914bff16e2 on hv-cinder-85694 Sep 11 08:49:06.587437 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-d79baccb-5e26-41c4-a7bb-e2d0139b398f req-8b4effec-d795-4a9c-b6b7-07534540a0a8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109653 Sep 11 08:49:06.588047 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 144/295] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:49:06.843567 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-70029a62-89a2-4f09-9d40-0b0ed990ab26 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:06.844178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-70029a62-89a2-4f09-9d40-0b0ed990ab26 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:06.853159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70029a62-89a2-4f09-9d40-0b0ed990ab26 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:06.853647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70029a62-89a2-4f09-9d40-0b0ed990ab26 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:06.854071 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70029a62-89a2-4f09-9d40-0b0ed990ab26 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:06.854804 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70029a62-89a2-4f09-9d40-0b0ed990ab26 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:06.855262 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70029a62-89a2-4f09-9d40-0b0ed990ab26 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:06.855694 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70029a62-89a2-4f09-9d40-0b0ed990ab26 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:07.007536 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-70029a62-89a2-4f09-9d40-0b0ed990ab26 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:07.021541 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-70029a62-89a2-4f09-9d40-0b0ed990ab26 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1313 microversion: 2.1 time: 0.177687 Sep 11 08:49:07.022765 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 152/296] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:06 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:07.065993 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f9499876-0525-4803-8006-96612fe2e5fe tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:07.066977 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f9499876-0525-4803-8006-96612fe2e5fe tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:07.092726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-87df9561-c456-4bc9-a789-1fd8aac8cce8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:07.094608 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-87df9561-c456-4bc9-a789-1fd8aac8cce8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:07.108959 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87df9561-c456-4bc9-a789-1fd8aac8cce8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:07.109465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87df9561-c456-4bc9-a789-1fd8aac8cce8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:07.109904 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87df9561-c456-4bc9-a789-1fd8aac8cce8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:07.112953 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87df9561-c456-4bc9-a789-1fd8aac8cce8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:07.113437 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87df9561-c456-4bc9-a789-1fd8aac8cce8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:07.113877 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87df9561-c456-4bc9-a789-1fd8aac8cce8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:07.231397 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f9499876-0525-4803-8006-96612fe2e5fe tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:07.245021 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f9499876-0525-4803-8006-96612fe2e5fe tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1214 microversion: 2.1 time: 0.184009 Sep 11 08:49:07.246458 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 145/297] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:07 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:07.366084 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-87df9561-c456-4bc9-a789-1fd8aac8cce8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:07.400622 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-87df9561-c456-4bc9-a789-1fd8aac8cce8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.321561 Sep 11 08:49:07.406023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 153/298] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:07 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:07.502856 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-66c7cad9-cf3d-48ba-86b6-554c8c30cfb9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:07.506417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-66c7cad9-cf3d-48ba-86b6-554c8c30cfb9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:07.513189 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66c7cad9-cf3d-48ba-86b6-554c8c30cfb9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:07.513997 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66c7cad9-cf3d-48ba-86b6-554c8c30cfb9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:07.514648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66c7cad9-cf3d-48ba-86b6-554c8c30cfb9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:07.515519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66c7cad9-cf3d-48ba-86b6-554c8c30cfb9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:07.516273 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66c7cad9-cf3d-48ba-86b6-554c8c30cfb9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:07.516839 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66c7cad9-cf3d-48ba-86b6-554c8c30cfb9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:07.535126 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:07.535839 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:07.548127 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:07.548639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:07.552363 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:07.553425 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:07.554180 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:07.557244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:07.759825 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:07.773244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:07.777748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:07.777748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0cc2bd31-a064-4a9b-ac5d-3dee275fe867 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.247336 Sep 11 08:49:07.779002 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 154/299] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:07 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:49:07.832215 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-66c7cad9-cf3d-48ba-86b6-554c8c30cfb9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:07.846103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-66c7cad9-cf3d-48ba-86b6-554c8c30cfb9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.347006 Sep 11 08:49:07.847115 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 146/300] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:07 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:08.044906 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5e2d6c35-8ebd-429e-baad-cccf044d65d1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:08.047790 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5e2d6c35-8ebd-429e-baad-cccf044d65d1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:08.059532 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c35-8ebd-429e-baad-cccf044d65d1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:08.060043 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c35-8ebd-429e-baad-cccf044d65d1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:08.060471 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c35-8ebd-429e-baad-cccf044d65d1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:08.061190 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c35-8ebd-429e-baad-cccf044d65d1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:08.061652 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c35-8ebd-429e-baad-cccf044d65d1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:08.062076 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e2d6c35-8ebd-429e-baad-cccf044d65d1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:08.230634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5e2d6c35-8ebd-429e-baad-cccf044d65d1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:08.240374 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5e2d6c35-8ebd-429e-baad-cccf044d65d1 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1313 microversion: 2.1 time: 0.199293 Sep 11 08:49:08.241044 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 155/301] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:08 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:08.271005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a7e31374-7801-4a56-a729-6507cfb6a7e6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:08.272027 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a7e31374-7801-4a56-a729-6507cfb6a7e6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:08.282891 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a7e31374-7801-4a56-a729-6507cfb6a7e6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:08.283395 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a7e31374-7801-4a56-a729-6507cfb6a7e6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:08.283839 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a7e31374-7801-4a56-a729-6507cfb6a7e6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:08.284570 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a7e31374-7801-4a56-a729-6507cfb6a7e6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:08.285027 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a7e31374-7801-4a56-a729-6507cfb6a7e6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:08.285454 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a7e31374-7801-4a56-a729-6507cfb6a7e6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:08.372296 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a7e31374-7801-4a56-a729-6507cfb6a7e6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:08.388630 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a7e31374-7801-4a56-a729-6507cfb6a7e6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1218 microversion: 2.1 time: 0.123331 Sep 11 08:49:08.404048 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 147/302] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:08 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:08.445192 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-312cb844-8b08-425d-98ac-8fb237a9dd35 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:08.446207 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-312cb844-8b08-425d-98ac-8fb237a9dd35 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:08.475203 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-312cb844-8b08-425d-98ac-8fb237a9dd35 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:08.475957 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-312cb844-8b08-425d-98ac-8fb237a9dd35 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:08.476631 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-312cb844-8b08-425d-98ac-8fb237a9dd35 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:08.477515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-312cb844-8b08-425d-98ac-8fb237a9dd35 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:08.478232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-312cb844-8b08-425d-98ac-8fb237a9dd35 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:08.478962 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-312cb844-8b08-425d-98ac-8fb237a9dd35 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:08.685105 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-312cb844-8b08-425d-98ac-8fb237a9dd35 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:08.694294 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-312cb844-8b08-425d-98ac-8fb237a9dd35 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.269837 Sep 11 08:49:08.694886 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 156/303] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:08 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:08.822783 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:08.824364 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:08.835566 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:08.851132 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:08.851132 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:08.851132 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:08.851132 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:08.851514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:08.957361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b7c26bed-e1c4-4ab9-a815-24e180265ccb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:08.957361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b7c26bed-e1c4-4ab9-a815-24e180265ccb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:08.957361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7c26bed-e1c4-4ab9-a815-24e180265ccb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:08.957361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7c26bed-e1c4-4ab9-a815-24e180265ccb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:08.958482 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7c26bed-e1c4-4ab9-a815-24e180265ccb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:08.958482 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7c26bed-e1c4-4ab9-a815-24e180265ccb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:08.958482 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7c26bed-e1c4-4ab9-a815-24e180265ccb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:08.958482 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7c26bed-e1c4-4ab9-a815-24e180265ccb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:09.126391 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:09.146110 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:09.153116 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:09.154679 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b506d003-a08e-4071-bd5f-a456c38a18e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.336198 Sep 11 08:49:09.182517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b7c26bed-e1c4-4ab9-a815-24e180265ccb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:09.182517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b7c26bed-e1c4-4ab9-a815-24e180265ccb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.301364 Sep 11 08:49:09.182517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 157/304] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:08 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:09.183457 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 148/305] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:08 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:09.271659 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f1228c77-84c7-4a1f-bdeb-c2e4cd386d97 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:09.272339 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f1228c77-84c7-4a1f-bdeb-c2e4cd386d97 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:09.278736 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f1228c77-84c7-4a1f-bdeb-c2e4cd386d97 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:09.279306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f1228c77-84c7-4a1f-bdeb-c2e4cd386d97 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:09.279753 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f1228c77-84c7-4a1f-bdeb-c2e4cd386d97 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:09.280470 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f1228c77-84c7-4a1f-bdeb-c2e4cd386d97 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:09.280925 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f1228c77-84c7-4a1f-bdeb-c2e4cd386d97 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:09.281351 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f1228c77-84c7-4a1f-bdeb-c2e4cd386d97 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:09.416842 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-63382c27-d9f9-447f-8c79-f749b7c6f46f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:09.417857 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-63382c27-d9f9-447f-8c79-f749b7c6f46f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:09.432840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63382c27-d9f9-447f-8c79-f749b7c6f46f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:09.433678 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63382c27-d9f9-447f-8c79-f749b7c6f46f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:09.434624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63382c27-d9f9-447f-8c79-f749b7c6f46f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:09.435530 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63382c27-d9f9-447f-8c79-f749b7c6f46f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:09.436297 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63382c27-d9f9-447f-8c79-f749b7c6f46f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:09.441670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63382c27-d9f9-447f-8c79-f749b7c6f46f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:09.474533 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f1228c77-84c7-4a1f-bdeb-c2e4cd386d97 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:09.486936 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f1228c77-84c7-4a1f-bdeb-c2e4cd386d97 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1495 microversion: 2.1 time: 0.219842 Sep 11 08:49:09.507140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 158/306] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:09 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1495 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:09.540811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-63382c27-d9f9-447f-8c79-f749b7c6f46f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:09.550401 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-63382c27-d9f9-447f-8c79-f749b7c6f46f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1218 microversion: 2.1 time: 0.138119 Sep 11 08:49:09.552051 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 149/307] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:09 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:09.727928 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0e45ab62-2d72-4bfa-8945-fe96e48fa557 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:09.729263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0e45ab62-2d72-4bfa-8945-fe96e48fa557 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:09.755623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0e45ab62-2d72-4bfa-8945-fe96e48fa557 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:09.755623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0e45ab62-2d72-4bfa-8945-fe96e48fa557 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:09.755623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0e45ab62-2d72-4bfa-8945-fe96e48fa557 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:09.755623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0e45ab62-2d72-4bfa-8945-fe96e48fa557 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:09.755991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0e45ab62-2d72-4bfa-8945-fe96e48fa557 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:09.766626 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0e45ab62-2d72-4bfa-8945-fe96e48fa557 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:10.019505 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0e45ab62-2d72-4bfa-8945-fe96e48fa557 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:10.029415 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0e45ab62-2d72-4bfa-8945-fe96e48fa557 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.308007 Sep 11 08:49:10.030597 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 159/308] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:09 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:10.199683 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:10.200316 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b8c54952-6040-41fa-9617-0da5c0a58971 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:10.200948 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b8c54952-6040-41fa-9617-0da5c0a58971 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:10.201305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:10.210681 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b8c54952-6040-41fa-9617-0da5c0a58971 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:10.211485 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b8c54952-6040-41fa-9617-0da5c0a58971 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:10.212601 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b8c54952-6040-41fa-9617-0da5c0a58971 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:10.214076 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b8c54952-6040-41fa-9617-0da5c0a58971 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:10.215107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b8c54952-6040-41fa-9617-0da5c0a58971 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:10.215754 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b8c54952-6040-41fa-9617-0da5c0a58971 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:10.217387 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:10.221192 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:10.221192 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:10.221192 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:10.221192 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:10.221552 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:10.475785 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b8c54952-6040-41fa-9617-0da5c0a58971 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:10.480477 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:10.488857 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b8c54952-6040-41fa-9617-0da5c0a58971 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.292815 Sep 11 08:49:10.498233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 160/309] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:10 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:10.504671 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:10.512886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:10.512886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-811805a4-d38f-4726-9bbc-059f7f07097a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.317303 Sep 11 08:49:10.514481 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 150/310] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:10 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:10.579674 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-53a40cd5-af92-4094-b28f-37a1d5b5d16f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:10.579674 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-53a40cd5-af92-4094-b28f-37a1d5b5d16f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:10.585374 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-53a40cd5-af92-4094-b28f-37a1d5b5d16f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:10.591605 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-53a40cd5-af92-4094-b28f-37a1d5b5d16f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:10.592352 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-53a40cd5-af92-4094-b28f-37a1d5b5d16f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:10.593359 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-53a40cd5-af92-4094-b28f-37a1d5b5d16f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:10.593997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-53a40cd5-af92-4094-b28f-37a1d5b5d16f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:10.594558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-53a40cd5-af92-4094-b28f-37a1d5b5d16f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:10.663623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-53a40cd5-af92-4094-b28f-37a1d5b5d16f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:10.675331 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-53a40cd5-af92-4094-b28f-37a1d5b5d16f tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1218 microversion: 2.1 time: 0.103541 Sep 11 08:49:10.675928 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 161/311] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:10 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:11.072859 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2801929a-7b77-460d-ad28-e55540942358 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:11.073999 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2801929a-7b77-460d-ad28-e55540942358 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:11.081863 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2801929a-7b77-460d-ad28-e55540942358 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:11.092285 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2801929a-7b77-460d-ad28-e55540942358 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:11.097001 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2801929a-7b77-460d-ad28-e55540942358 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:11.099992 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2801929a-7b77-460d-ad28-e55540942358 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:11.101736 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2801929a-7b77-460d-ad28-e55540942358 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:11.104034 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2801929a-7b77-460d-ad28-e55540942358 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:11.352066 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9a9d7238-f957-4b00-bc2a-0a5b0cc1e8e9 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:11.353929 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9a9d7238-f957-4b00-bc2a-0a5b0cc1e8e9 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:11.366868 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9a9d7238-f957-4b00-bc2a-0a5b0cc1e8e9 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:11.368808 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9a9d7238-f957-4b00-bc2a-0a5b0cc1e8e9 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:11.370439 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9a9d7238-f957-4b00-bc2a-0a5b0cc1e8e9 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:11.370439 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9a9d7238-f957-4b00-bc2a-0a5b0cc1e8e9 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:11.371801 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9a9d7238-f957-4b00-bc2a-0a5b0cc1e8e9 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:11.372351 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9a9d7238-f957-4b00-bc2a-0a5b0cc1e8e9 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:11.380517 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2801929a-7b77-460d-ad28-e55540942358 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:11.391659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2801929a-7b77-460d-ad28-e55540942358 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.327343 Sep 11 08:49:11.393239 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 151/312] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:11 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:11.444317 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9a9d7238-f957-4b00-bc2a-0a5b0cc1e8e9 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:49:11.446768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:11.523985 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2ae0957d-706b-4a56-a9de-2715eb100881 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:11.525678 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2ae0957d-706b-4a56-a9de-2715eb100881 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:11.560923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ae0957d-706b-4a56-a9de-2715eb100881 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:11.560923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ae0957d-706b-4a56-a9de-2715eb100881 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:11.562550 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ae0957d-706b-4a56-a9de-2715eb100881 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:11.565467 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ae0957d-706b-4a56-a9de-2715eb100881 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:11.569554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ae0957d-706b-4a56-a9de-2715eb100881 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:11.570927 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2ae0957d-706b-4a56-a9de-2715eb100881 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:11.837726 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2ae0957d-706b-4a56-a9de-2715eb100881 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:11.861365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2ae0957d-706b-4a56-a9de-2715eb100881 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.347874 Sep 11 08:49:11.862799 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 152/313] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:11 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:11.868535 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:11.870312 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:11.877279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:11.880543 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:11.881225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:11.881950 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:11.882759 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:11.883344 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:12.057247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9a9d7238-f957-4b00-bc2a-0a5b0cc1e8e9 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 204 len: 0 microversion: 2.1 time: 0.710620 Sep 11 08:49:12.059376 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 162/314] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:49:11 2022] DELETE /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 08:49:12.068689 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d903915c-0130-4691-a255-96f3418fc8ee tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:12.069404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d903915c-0130-4691-a255-96f3418fc8ee tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:12.071450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:12.076418 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d903915c-0130-4691-a255-96f3418fc8ee tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:12.077161 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d903915c-0130-4691-a255-96f3418fc8ee tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:12.077761 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d903915c-0130-4691-a255-96f3418fc8ee tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:12.078908 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d903915c-0130-4691-a255-96f3418fc8ee tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:12.079519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d903915c-0130-4691-a255-96f3418fc8ee tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:12.080102 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d903915c-0130-4691-a255-96f3418fc8ee tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:12.105340 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:12.116856 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:12.118414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:12.119887 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3d7428a0-8339-4f2b-b340-cf435eec1cea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.255958 Sep 11 08:49:12.120628 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 153/315] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:11 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:12.125570 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-89155ba5-f731-4d08-ac11-00ece6f07a67 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:12.126416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-89155ba5-f731-4d08-ac11-00ece6f07a67 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:12.144666 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89155ba5-f731-4d08-ac11-00ece6f07a67 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:12.148308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89155ba5-f731-4d08-ac11-00ece6f07a67 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:12.148308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89155ba5-f731-4d08-ac11-00ece6f07a67 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:12.148308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89155ba5-f731-4d08-ac11-00ece6f07a67 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:12.148308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89155ba5-f731-4d08-ac11-00ece6f07a67 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:12.148792 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89155ba5-f731-4d08-ac11-00ece6f07a67 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:12.169878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d903915c-0130-4691-a255-96f3418fc8ee tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:12.178901 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d903915c-0130-4691-a255-96f3418fc8ee tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1218 microversion: 2.1 time: 0.116256 Sep 11 08:49:12.180069 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 163/316] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:12 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:12.438577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-fe2da535-9f98-414e-9f47-61e96800b56f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:12.438699 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-fe2da535-9f98-414e-9f47-61e96800b56f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:12.472454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe2da535-9f98-414e-9f47-61e96800b56f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:12.478343 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe2da535-9f98-414e-9f47-61e96800b56f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:12.479479 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe2da535-9f98-414e-9f47-61e96800b56f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:12.480892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe2da535-9f98-414e-9f47-61e96800b56f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:12.485523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe2da535-9f98-414e-9f47-61e96800b56f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:12.488941 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe2da535-9f98-414e-9f47-61e96800b56f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:12.590563 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-89155ba5-f731-4d08-ac11-00ece6f07a67 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:12.603464 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-89155ba5-f731-4d08-ac11-00ece6f07a67 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1501 microversion: 2.1 time: 0.481575 Sep 11 08:49:12.604904 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 154/317] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:12 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1501 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:12.889063 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4e6032ec-59e5-45d8-b74d-9b384cf1a744 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:12.890331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4e6032ec-59e5-45d8-b74d-9b384cf1a744 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:12.905721 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4e6032ec-59e5-45d8-b74d-9b384cf1a744 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:12.911907 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4e6032ec-59e5-45d8-b74d-9b384cf1a744 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:12.911907 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4e6032ec-59e5-45d8-b74d-9b384cf1a744 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:12.911907 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4e6032ec-59e5-45d8-b74d-9b384cf1a744 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:12.911907 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4e6032ec-59e5-45d8-b74d-9b384cf1a744 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:12.912303 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4e6032ec-59e5-45d8-b74d-9b384cf1a744 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:12.912409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-fe2da535-9f98-414e-9f47-61e96800b56f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:12.928897 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-fe2da535-9f98-414e-9f47-61e96800b56f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.506393 Sep 11 08:49:12.943305 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 164/318] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:12 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:13.130990 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4e6032ec-59e5-45d8-b74d-9b384cf1a744 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:13.155602 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:13.160266 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4e6032ec-59e5-45d8-b74d-9b384cf1a744 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.277988 Sep 11 08:49:13.162553 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:13.182207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 155/319] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:12 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:13.182462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:13.182462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:13.182462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:13.182462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:13.182750 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:13.182750 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:13.207404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b8bb770c-4328-4069-a979-81d6ce0d5217 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:13.210940 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b8bb770c-4328-4069-a979-81d6ce0d5217 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:13.230558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8bb770c-4328-4069-a979-81d6ce0d5217 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:13.231712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8bb770c-4328-4069-a979-81d6ce0d5217 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:13.232884 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8bb770c-4328-4069-a979-81d6ce0d5217 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:13.234705 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8bb770c-4328-4069-a979-81d6ce0d5217 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:13.235780 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8bb770c-4328-4069-a979-81d6ce0d5217 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:13.236546 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b8bb770c-4328-4069-a979-81d6ce0d5217 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:13.370581 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b8bb770c-4328-4069-a979-81d6ce0d5217 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:13.397316 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b8bb770c-4328-4069-a979-81d6ce0d5217 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1218 microversion: 2.1 time: 0.196801 Sep 11 08:49:13.398691 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 156/320] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:13 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1218 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:13.632012 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:13.646894 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:13.648255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5e5b2004-1423-42df-976b-6c97d229bd93 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:13.649061 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:13.649201 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5e5b2004-1423-42df-976b-6c97d229bd93 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:13.650532 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b6a60d9b-c0dd-46f3-be7a-1159513101dc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.502385 Sep 11 08:49:13.666176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 165/321] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:13 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:13.674395 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5e5b2004-1423-42df-976b-6c97d229bd93 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:13.674395 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5e5b2004-1423-42df-976b-6c97d229bd93 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:13.675102 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5e5b2004-1423-42df-976b-6c97d229bd93 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:13.675952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5e5b2004-1423-42df-976b-6c97d229bd93 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:13.676670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5e5b2004-1423-42df-976b-6c97d229bd93 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:13.677065 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5e5b2004-1423-42df-976b-6c97d229bd93 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:13.896152 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5e5b2004-1423-42df-976b-6c97d229bd93 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:13.906553 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5e5b2004-1423-42df-976b-6c97d229bd93 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1501 microversion: 2.1 time: 0.265262 Sep 11 08:49:13.907855 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 157/322] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:13 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1501 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:13.975293 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3151302b-506f-48a2-98ad-f3fc57bacd3e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:13.976847 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3151302b-506f-48a2-98ad-f3fc57bacd3e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:13.987793 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3151302b-506f-48a2-98ad-f3fc57bacd3e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:13.988532 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3151302b-506f-48a2-98ad-f3fc57bacd3e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:13.990102 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3151302b-506f-48a2-98ad-f3fc57bacd3e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:13.991458 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3151302b-506f-48a2-98ad-f3fc57bacd3e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:13.992306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3151302b-506f-48a2-98ad-f3fc57bacd3e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:13.993011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3151302b-506f-48a2-98ad-f3fc57bacd3e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:14.207061 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6ec554b5-81e9-4648-871e-c1798e580950 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:14.208326 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6ec554b5-81e9-4648-871e-c1798e580950 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:14.227301 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:14.230692 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ec554b5-81e9-4648-871e-c1798e580950 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:14.233745 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ec554b5-81e9-4648-871e-c1798e580950 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:14.234366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ec554b5-81e9-4648-871e-c1798e580950 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:14.235807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ec554b5-81e9-4648-871e-c1798e580950 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:14.235807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ec554b5-81e9-4648-871e-c1798e580950 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:14.236133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ec554b5-81e9-4648-871e-c1798e580950 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:14.296930 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3151302b-506f-48a2-98ad-f3fc57bacd3e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:14.327737 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3151302b-506f-48a2-98ad-f3fc57bacd3e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.361091 Sep 11 08:49:14.328857 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 166/323] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:13 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:14.425338 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-31c5a030-d6f6-425d-ad24-674632c77d1a tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:14.425995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-31c5a030-d6f6-425d-ad24-674632c77d1a tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:14.440107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31c5a030-d6f6-425d-ad24-674632c77d1a tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:14.440960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31c5a030-d6f6-425d-ad24-674632c77d1a tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:14.443324 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31c5a030-d6f6-425d-ad24-674632c77d1a tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:14.444451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31c5a030-d6f6-425d-ad24-674632c77d1a tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:14.448386 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31c5a030-d6f6-425d-ad24-674632c77d1a tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:14.449015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31c5a030-d6f6-425d-ad24-674632c77d1a tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:14.469702 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6ec554b5-81e9-4648-871e-c1798e580950 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:14.475222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:14.506391 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6ec554b5-81e9-4648-871e-c1798e580950 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.291036 Sep 11 08:49:14.506391 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 158/324] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:14 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:14.657038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-31c5a030-d6f6-425d-ad24-674632c77d1a tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:14.670423 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-31c5a030-d6f6-425d-ad24-674632c77d1a tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1218 microversion: 2.1 time: 0.245205 Sep 11 08:49:14.670423 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 167/325] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:14 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1218 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:14.708818 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:14.711930 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:14.763024 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:14.763440 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:14.764089 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:14.764913 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:14.765304 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:14.765727 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:14.932387 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-20c37c05-43e3-4e2b-a5fd-2b97a1c7852a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:14.937239 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-20c37c05-43e3-4e2b-a5fd-2b97a1c7852a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:14.942000 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20c37c05-43e3-4e2b-a5fd-2b97a1c7852a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:14.942892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20c37c05-43e3-4e2b-a5fd-2b97a1c7852a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:14.943553 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20c37c05-43e3-4e2b-a5fd-2b97a1c7852a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:14.945038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20c37c05-43e3-4e2b-a5fd-2b97a1c7852a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:14.945840 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20c37c05-43e3-4e2b-a5fd-2b97a1c7852a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:14.946554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20c37c05-43e3-4e2b-a5fd-2b97a1c7852a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:15.100322 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:15.111996 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:15.113451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:15.114725 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-01709bbc-834f-463f-928b-139fc548799e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1743 microversion: 2.20 time: 0.430598 Sep 11 08:49:15.115284 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 159/326] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:14 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1743 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:15.156877 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-20c37c05-43e3-4e2b-a5fd-2b97a1c7852a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:15.165551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-20c37c05-43e3-4e2b-a5fd-2b97a1c7852a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1501 microversion: 2.1 time: 0.237347 Sep 11 08:49:15.166183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 168/327] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:14 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1501 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:15.380259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fb84e962-4792-4e66-ac54-14b0bcabc882 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:15.384146 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-fb84e962-4792-4e66-ac54-14b0bcabc882 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:15.384146 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=6 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:15.388077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb84e962-4792-4e66-ac54-14b0bcabc882 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:15.388560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb84e962-4792-4e66-ac54-14b0bcabc882 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:15.388988 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb84e962-4792-4e66-ac54-14b0bcabc882 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:15.389666 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb84e962-4792-4e66-ac54-14b0bcabc882 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:15.390116 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb84e962-4792-4e66-ac54-14b0bcabc882 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:15.390561 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb84e962-4792-4e66-ac54-14b0bcabc882 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:15.524152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5e859503-d63c-4278-93c6-ab0aca098de6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:15.524882 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5e859503-d63c-4278-93c6-ab0aca098de6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:15.533991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e859503-d63c-4278-93c6-ab0aca098de6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:15.534517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e859503-d63c-4278-93c6-ab0aca098de6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:15.535056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e859503-d63c-4278-93c6-ab0aca098de6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:15.538512 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e859503-d63c-4278-93c6-ab0aca098de6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:15.539041 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e859503-d63c-4278-93c6-ab0aca098de6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:15.539875 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5e859503-d63c-4278-93c6-ab0aca098de6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:15.595833 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fb84e962-4792-4e66-ac54-14b0bcabc882 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:15.616223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-fb84e962-4792-4e66-ac54-14b0bcabc882 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.237274 Sep 11 08:49:15.634546 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 160/328] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:15 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:15.721905 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9425cf37-596b-4480-9ae9-48127bc2faa1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:15.722623 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9425cf37-596b-4480-9ae9-48127bc2faa1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:15.731871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5e859503-d63c-4278-93c6-ab0aca098de6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:15.735974 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9425cf37-596b-4480-9ae9-48127bc2faa1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:15.736842 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9425cf37-596b-4480-9ae9-48127bc2faa1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:15.737450 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9425cf37-596b-4480-9ae9-48127bc2faa1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:15.738526 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9425cf37-596b-4480-9ae9-48127bc2faa1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:15.739081 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9425cf37-596b-4480-9ae9-48127bc2faa1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:15.740068 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9425cf37-596b-4480-9ae9-48127bc2faa1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:15.741366 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5e859503-d63c-4278-93c6-ab0aca098de6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.222219 Sep 11 08:49:15.742475 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 169/329] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:15 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:15.825246 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a2948f01-c834-4a40-8806-a37b3fe52ceb tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:15.835019 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a2948f01-c834-4a40-8806-a37b3fe52ceb tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:15.835865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a2948f01-c834-4a40-8806-a37b3fe52ceb tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:15.836635 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a2948f01-c834-4a40-8806-a37b3fe52ceb tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:15.838024 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9425cf37-596b-4480-9ae9-48127bc2faa1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:15.852955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9425cf37-596b-4480-9ae9-48127bc2faa1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1218 microversion: 2.1 time: 0.136979 Sep 11 08:49:15.868995 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 161/330] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:15 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:15.934827 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a2948f01-c834-4a40-8806-a37b3fe52ceb tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Going to try to stop instance {{(pid=127647) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 11 08:49:16.142282 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:16.142904 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:16.149953 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.150442 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.150865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.151582 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.152029 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.152457 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.212840 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a2948f01-c834-4a40-8806-a37b3fe52ceb tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "POST /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/action" status: 202 len: 0 microversion: 2.1 time: 0.391872 Sep 11 08:49:16.213572 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 170/331] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:49:15 2022] POST /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 08:49:16.222878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-413a5fd1-3cc6-4cee-a621-c7921b522b9a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:16.223639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-413a5fd1-3cc6-4cee-a621-c7921b522b9a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:16.230706 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413a5fd1-3cc6-4cee-a621-c7921b522b9a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.231500 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413a5fd1-3cc6-4cee-a621-c7921b522b9a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.232274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413a5fd1-3cc6-4cee-a621-c7921b522b9a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.233610 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413a5fd1-3cc6-4cee-a621-c7921b522b9a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.234163 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413a5fd1-3cc6-4cee-a621-c7921b522b9a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.234678 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413a5fd1-3cc6-4cee-a621-c7921b522b9a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.356768 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:16.374962 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:16.376640 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:16.378094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b298ee6f-9eff-48eb-906a-7a75e3f7c5a2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1743 microversion: 2.20 time: 0.240464 Sep 11 08:49:16.394575 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 162/332] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:16 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:49:16.403199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-54e94e71-00a1-41ca-bf4c-4cb4bd3bdf36 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:16.404025 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-54e94e71-00a1-41ca-bf4c-4cb4bd3bdf36 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:16.415118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54e94e71-00a1-41ca-bf4c-4cb4bd3bdf36 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.416003 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54e94e71-00a1-41ca-bf4c-4cb4bd3bdf36 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.416813 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54e94e71-00a1-41ca-bf4c-4cb4bd3bdf36 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.417691 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54e94e71-00a1-41ca-bf4c-4cb4bd3bdf36 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.418945 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54e94e71-00a1-41ca-bf4c-4cb4bd3bdf36 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.419405 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54e94e71-00a1-41ca-bf4c-4cb4bd3bdf36 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.432820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-413a5fd1-3cc6-4cee-a621-c7921b522b9a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:16.441908 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-413a5fd1-3cc6-4cee-a621-c7921b522b9a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1501 microversion: 2.1 time: 0.227018 Sep 11 08:49:16.442624 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 171/333] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:16 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:16.573318 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-54e94e71-00a1-41ca-bf4c-4cb4bd3bdf36 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:16.587609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-54e94e71-00a1-41ca-bf4c-4cb4bd3bdf36 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.190997 Sep 11 08:49:16.588379 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 163/334] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:16 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:16.642306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3aae6331-7210-488a-8d23-6d8cfb1299ff tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:16.644749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3aae6331-7210-488a-8d23-6d8cfb1299ff tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:16.654553 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3aae6331-7210-488a-8d23-6d8cfb1299ff tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.655395 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3aae6331-7210-488a-8d23-6d8cfb1299ff tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.656058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3aae6331-7210-488a-8d23-6d8cfb1299ff tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.657020 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3aae6331-7210-488a-8d23-6d8cfb1299ff tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.657652 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3aae6331-7210-488a-8d23-6d8cfb1299ff tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.658364 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3aae6331-7210-488a-8d23-6d8cfb1299ff tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.721237 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-582a7a08-6756-4d08-b59d-14caa5310198 req-9657d2a6-e18d-4b31-b834-a72eee02055a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223e4b7b-8a6c-4647-aa91-aae73dbeb340", "name": "network-vif-plugged", "status": "completed", "tag": "a3c9ee62-2858-49c8-b169-41636e1c8bdd"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:16.733254 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-582a7a08-6756-4d08-b59d-14caa5310198 req-9657d2a6-e18d-4b31-b834-a72eee02055a service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.734337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-582a7a08-6756-4d08-b59d-14caa5310198 req-9657d2a6-e18d-4b31-b834-a72eee02055a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.734337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-582a7a08-6756-4d08-b59d-14caa5310198 req-9657d2a6-e18d-4b31-b834-a72eee02055a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.747881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-582a7a08-6756-4d08-b59d-14caa5310198 req-9657d2a6-e18d-4b31-b834-a72eee02055a service nova] Creating event network-vif-plugged:a3c9ee62-2858-49c8-b169-41636e1c8bdd for instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 on hv-cinder-85694 Sep 11 08:49:16.758138 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-582a7a08-6756-4d08-b59d-14caa5310198 req-9657d2a6-e18d-4b31-b834-a72eee02055a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044492 Sep 11 08:49:16.759843 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 164/335] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:49:16.774043 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5089bb23-3d88-4e0d-b934-28aa5f76e9bc tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:16.775692 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5089bb23-3d88-4e0d-b934-28aa5f76e9bc tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:16.789161 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5089bb23-3d88-4e0d-b934-28aa5f76e9bc tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.790771 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5089bb23-3d88-4e0d-b934-28aa5f76e9bc tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.791624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5089bb23-3d88-4e0d-b934-28aa5f76e9bc tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.793432 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5089bb23-3d88-4e0d-b934-28aa5f76e9bc tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.794830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5089bb23-3d88-4e0d-b934-28aa5f76e9bc tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.796429 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5089bb23-3d88-4e0d-b934-28aa5f76e9bc tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.849506 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:16.866882 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3aae6331-7210-488a-8d23-6d8cfb1299ff tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:16.903735 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3aae6331-7210-488a-8d23-6d8cfb1299ff tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.265786 Sep 11 08:49:16.904946 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 172/336] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:16 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:16.917926 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c74046aa-14e5-4919-9183-ba0d2e63e6fb tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:16.919538 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c74046aa-14e5-4919-9183-ba0d2e63e6fb tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:16.931936 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c74046aa-14e5-4919-9183-ba0d2e63e6fb tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.932903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c74046aa-14e5-4919-9183-ba0d2e63e6fb tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.933694 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c74046aa-14e5-4919-9183-ba0d2e63e6fb tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.934911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c74046aa-14e5-4919-9183-ba0d2e63e6fb tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:16.935739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c74046aa-14e5-4919-9183-ba0d2e63e6fb tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:16.936534 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c74046aa-14e5-4919-9183-ba0d2e63e6fb tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:16.992397 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5089bb23-3d88-4e0d-b934-28aa5f76e9bc tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:17.000906 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5089bb23-3d88-4e0d-b934-28aa5f76e9bc tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.237144 Sep 11 08:49:17.001695 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 165/337] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:16 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:17.041483 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c74046aa-14e5-4919-9183-ba0d2e63e6fb tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:17.049498 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c74046aa-14e5-4919-9183-ba0d2e63e6fb tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1210 microversion: 2.1 time: 0.141964 Sep 11 08:49:17.050446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 173/338] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:16 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1210 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:17.408110 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:17.409114 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:17.411966 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=22 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:17.423861 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:17.424594 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:17.425319 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:17.426031 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:17.426712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:17.427150 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:17.467336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b49f52af-6bed-4a28-b710-7e6f7507b2b7 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:17.468212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b49f52af-6bed-4a28-b710-7e6f7507b2b7 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:17.476460 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b49f52af-6bed-4a28-b710-7e6f7507b2b7 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:17.477896 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b49f52af-6bed-4a28-b710-7e6f7507b2b7 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:17.477896 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b49f52af-6bed-4a28-b710-7e6f7507b2b7 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:17.478333 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b49f52af-6bed-4a28-b710-7e6f7507b2b7 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:17.478796 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b49f52af-6bed-4a28-b710-7e6f7507b2b7 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:17.479210 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b49f52af-6bed-4a28-b710-7e6f7507b2b7 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:17.656080 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b49f52af-6bed-4a28-b710-7e6f7507b2b7 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:17.668186 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b49f52af-6bed-4a28-b710-7e6f7507b2b7 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1501 microversion: 2.1 time: 0.204817 Sep 11 08:49:17.668945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 174/339] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:17 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1501 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:17.679016 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2ca54a71-c2d2-4680-a444-9a7c2e423962 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:17.680541 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2ca54a71-c2d2-4680-a444-9a7c2e423962 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:17.693031 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ca54a71-c2d2-4680-a444-9a7c2e423962 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:17.694662 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ca54a71-c2d2-4680-a444-9a7c2e423962 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:17.695888 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ca54a71-c2d2-4680-a444-9a7c2e423962 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:17.710967 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ca54a71-c2d2-4680-a444-9a7c2e423962 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:17.712147 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ca54a71-c2d2-4680-a444-9a7c2e423962 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:17.713728 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ca54a71-c2d2-4680-a444-9a7c2e423962 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:17.803248 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:17.817835 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:17.821311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:17.824190 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-480a15a2-8c3f-4d99-b76f-66e28a511215 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1743 microversion: 2.20 time: 0.419664 Sep 11 08:49:17.825387 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 166/340] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:17 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1743 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:17.930092 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a63a2e42-b772-4279-a3b1-5a2f11fc545b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:17.930736 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a63a2e42-b772-4279-a3b1-5a2f11fc545b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:17.937527 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a63a2e42-b772-4279-a3b1-5a2f11fc545b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:17.938172 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a63a2e42-b772-4279-a3b1-5a2f11fc545b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:17.938867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a63a2e42-b772-4279-a3b1-5a2f11fc545b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:17.939808 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a63a2e42-b772-4279-a3b1-5a2f11fc545b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:17.940510 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a63a2e42-b772-4279-a3b1-5a2f11fc545b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:17.941222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a63a2e42-b772-4279-a3b1-5a2f11fc545b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:18.147325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2ca54a71-c2d2-4680-a444-9a7c2e423962 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:18.167116 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2ca54a71-c2d2-4680-a444-9a7c2e423962 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.496114 Sep 11 08:49:18.168577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 175/341] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:17 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:18.178839 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b38327eb-d2c3-4178-8459-0f62d40bdd9f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:18.186454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b38327eb-d2c3-4178-8459-0f62d40bdd9f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:18.199802 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b38327eb-d2c3-4178-8459-0f62d40bdd9f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:18.201318 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b38327eb-d2c3-4178-8459-0f62d40bdd9f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:18.202605 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b38327eb-d2c3-4178-8459-0f62d40bdd9f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:18.204175 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b38327eb-d2c3-4178-8459-0f62d40bdd9f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:18.205255 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b38327eb-d2c3-4178-8459-0f62d40bdd9f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:18.206317 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b38327eb-d2c3-4178-8459-0f62d40bdd9f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:18.485874 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a63a2e42-b772-4279-a3b1-5a2f11fc545b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:18.537752 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a63a2e42-b772-4279-a3b1-5a2f11fc545b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.610718 Sep 11 08:49:18.538906 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 167/342] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:17 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:18.572710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b771ae51-8656-4141-9230-effd60fe97b1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:18.577615 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b771ae51-8656-4141-9230-effd60fe97b1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:18.604308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b771ae51-8656-4141-9230-effd60fe97b1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:18.605856 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b771ae51-8656-4141-9230-effd60fe97b1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:18.613454 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b771ae51-8656-4141-9230-effd60fe97b1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:18.613454 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b771ae51-8656-4141-9230-effd60fe97b1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:18.613454 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b771ae51-8656-4141-9230-effd60fe97b1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:18.631018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b771ae51-8656-4141-9230-effd60fe97b1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:18.806352 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b38327eb-d2c3-4178-8459-0f62d40bdd9f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:18.809287 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:18.818222 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b38327eb-d2c3-4178-8459-0f62d40bdd9f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.647769 Sep 11 08:49:18.819823 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 176/343] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:18 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:18.828767 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-19830b3b-dd0d-421d-a965-b3ca374f41dc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:18.829930 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-19830b3b-dd0d-421d-a965-b3ca374f41dc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:18.837238 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19830b3b-dd0d-421d-a965-b3ca374f41dc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:18.838021 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19830b3b-dd0d-421d-a965-b3ca374f41dc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:18.838651 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19830b3b-dd0d-421d-a965-b3ca374f41dc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:18.839546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19830b3b-dd0d-421d-a965-b3ca374f41dc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:18.840172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19830b3b-dd0d-421d-a965-b3ca374f41dc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:18.840792 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19830b3b-dd0d-421d-a965-b3ca374f41dc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:19.111683 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-19830b3b-dd0d-421d-a965-b3ca374f41dc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:19.165922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-19830b3b-dd0d-421d-a965-b3ca374f41dc tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1501 microversion: 2.1 time: 0.299037 Sep 11 08:49:19.165922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 177/344] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:18 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1501 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:19.165922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:19.165922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:19.165922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:19.166462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:19.166462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:19.166462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:19.166462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:19.167249 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:19.281908 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b771ae51-8656-4141-9230-effd60fe97b1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:19.292621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b771ae51-8656-4141-9230-effd60fe97b1 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1266 microversion: 2.1 time: 0.751910 Sep 11 08:49:19.294213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 168/345] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:18 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1266 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:19.324032 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5ae85faa-9874-417f-abad-de578bd50e69 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:19.325696 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5ae85faa-9874-417f-abad-de578bd50e69 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:19.340954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ae85faa-9874-417f-abad-de578bd50e69 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:19.341890 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ae85faa-9874-417f-abad-de578bd50e69 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:19.342415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ae85faa-9874-417f-abad-de578bd50e69 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:19.343400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ae85faa-9874-417f-abad-de578bd50e69 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:19.344073 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ae85faa-9874-417f-abad-de578bd50e69 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:19.344725 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ae85faa-9874-417f-abad-de578bd50e69 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:19.410046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:19.419185 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:19.420927 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:19.422335 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d84f2b7c-40ad-4503-8562-552a71b4985c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1743 microversion: 2.20 time: 0.300080 Sep 11 08:49:19.423091 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 178/346] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:19 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1743 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:19.561805 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5ae85faa-9874-417f-abad-de578bd50e69 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:19.567917 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d1bd6623-6a2a-4d4d-9f22-5f52f06a7ec0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:19.568542 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d1bd6623-6a2a-4d4d-9f22-5f52f06a7ec0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:19.570827 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5ae85faa-9874-417f-abad-de578bd50e69 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.275238 Sep 11 08:49:19.571416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 169/347] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:19 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:19.575252 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d1bd6623-6a2a-4d4d-9f22-5f52f06a7ec0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:19.575860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d1bd6623-6a2a-4d4d-9f22-5f52f06a7ec0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:19.576433 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d1bd6623-6a2a-4d4d-9f22-5f52f06a7ec0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:19.577048 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d1bd6623-6a2a-4d4d-9f22-5f52f06a7ec0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:19.577507 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d1bd6623-6a2a-4d4d-9f22-5f52f06a7ec0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:19.577935 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d1bd6623-6a2a-4d4d-9f22-5f52f06a7ec0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:19.737005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-75fca15f-c874-480b-a541-8d8e06b5862b req-172b41fb-b20e-4bec-878d-9efc3fa49e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2432dc-8be1-4efd-8315-9c9e07a60050", "name": "network-vif-deleted", "tag": "2402bdec-75a8-4343-930a-de5d274eaaab"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:19.747612 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-75fca15f-c874-480b-a541-8d8e06b5862b req-172b41fb-b20e-4bec-878d-9efc3fa49e27 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:19.748249 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-75fca15f-c874-480b-a541-8d8e06b5862b req-172b41fb-b20e-4bec-878d-9efc3fa49e27 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:19.749031 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-75fca15f-c874-480b-a541-8d8e06b5862b req-172b41fb-b20e-4bec-878d-9efc3fa49e27 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:19.763488 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-75fca15f-c874-480b-a541-8d8e06b5862b req-172b41fb-b20e-4bec-878d-9efc3fa49e27 service nova] Creating event network-vif-deleted:2402bdec-75a8-4343-930a-de5d274eaaab for instance 4d2432dc-8be1-4efd-8315-9c9e07a60050 on hv-cinder-85694 Sep 11 08:49:19.770683 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-75fca15f-c874-480b-a541-8d8e06b5862b req-172b41fb-b20e-4bec-878d-9efc3fa49e27 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036940 Sep 11 08:49:19.771653 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 170/348] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:49:19.783516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d1bd6623-6a2a-4d4d-9f22-5f52f06a7ec0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:19.795622 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d1bd6623-6a2a-4d4d-9f22-5f52f06a7ec0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.231759 Sep 11 08:49:19.805936 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 179/349] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:19 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:19.855184 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7addd7fb-8123-433d-bf9a-ac520d517f7f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:19.856169 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7addd7fb-8123-433d-bf9a-ac520d517f7f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:19.863828 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7addd7fb-8123-433d-bf9a-ac520d517f7f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:19.864323 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7addd7fb-8123-433d-bf9a-ac520d517f7f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:19.864757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7addd7fb-8123-433d-bf9a-ac520d517f7f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:19.865551 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7addd7fb-8123-433d-bf9a-ac520d517f7f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:19.866003 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7addd7fb-8123-433d-bf9a-ac520d517f7f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:19.866465 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7addd7fb-8123-433d-bf9a-ac520d517f7f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:20.053915 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7addd7fb-8123-433d-bf9a-ac520d517f7f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:20.062278 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7addd7fb-8123-433d-bf9a-ac520d517f7f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.211319 Sep 11 08:49:20.062873 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 171/350] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:19 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:20.159230 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-70701487-13c4-45bb-ae26-c29085cedbdf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:20.160156 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-70701487-13c4-45bb-ae26-c29085cedbdf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:20.167226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70701487-13c4-45bb-ae26-c29085cedbdf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:20.167711 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70701487-13c4-45bb-ae26-c29085cedbdf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:20.168144 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70701487-13c4-45bb-ae26-c29085cedbdf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:20.168856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70701487-13c4-45bb-ae26-c29085cedbdf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:20.169306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70701487-13c4-45bb-ae26-c29085cedbdf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:20.169725 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70701487-13c4-45bb-ae26-c29085cedbdf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:20.295405 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-70701487-13c4-45bb-ae26-c29085cedbdf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:20.318210 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-70701487-13c4-45bb-ae26-c29085cedbdf tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1459 microversion: 2.1 time: 0.161909 Sep 11 08:49:20.326829 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 180/351] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:20 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:20.334798 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-188caed8-00ec-4de2-b6ff-e612ac0e4aab tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:20.335598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-188caed8-00ec-4de2-b6ff-e612ac0e4aab tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:20.352461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-188caed8-00ec-4de2-b6ff-e612ac0e4aab tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:20.358516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-188caed8-00ec-4de2-b6ff-e612ac0e4aab tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:20.362205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-188caed8-00ec-4de2-b6ff-e612ac0e4aab tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:20.362205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-188caed8-00ec-4de2-b6ff-e612ac0e4aab tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:20.362205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-188caed8-00ec-4de2-b6ff-e612ac0e4aab tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:20.362205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-188caed8-00ec-4de2-b6ff-e612ac0e4aab tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:20.437226 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-188caed8-00ec-4de2-b6ff-e612ac0e4aab tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:20.453774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-188caed8-00ec-4de2-b6ff-e612ac0e4aab tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1266 microversion: 2.1 time: 0.124592 Sep 11 08:49:20.458205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 172/352] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:20 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:20.492345 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:20.493108 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:20.501172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:20.501909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:20.502649 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:20.503978 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:20.505554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:20.506332 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:20.605616 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1c81baac-3f42-44e9-87df-77340f8fb60e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:20.608075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1c81baac-3f42-44e9-87df-77340f8fb60e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:20.620290 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c81baac-3f42-44e9-87df-77340f8fb60e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:20.634423 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c81baac-3f42-44e9-87df-77340f8fb60e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:20.635705 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c81baac-3f42-44e9-87df-77340f8fb60e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:20.655693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c81baac-3f42-44e9-87df-77340f8fb60e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:20.657115 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c81baac-3f42-44e9-87df-77340f8fb60e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:20.660603 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c81baac-3f42-44e9-87df-77340f8fb60e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:20.772768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:20.789805 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:20.795034 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:20.797756 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e00412c6-80cd-4a6d-9e13-11936d0378f3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1743 microversion: 2.20 time: 0.310990 Sep 11 08:49:20.800273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 181/353] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:20 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1743 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:20.829623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7b832a3f-1ba4-458c-86d2-5ee4629fe8d7 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:20.830573 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-7b832a3f-1ba4-458c-86d2-5ee4629fe8d7 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:20.839889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b832a3f-1ba4-458c-86d2-5ee4629fe8d7 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:20.841102 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b832a3f-1ba4-458c-86d2-5ee4629fe8d7 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:20.842214 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b832a3f-1ba4-458c-86d2-5ee4629fe8d7 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:20.843772 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b832a3f-1ba4-458c-86d2-5ee4629fe8d7 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:20.845043 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b832a3f-1ba4-458c-86d2-5ee4629fe8d7 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:20.846015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b832a3f-1ba4-458c-86d2-5ee4629fe8d7 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:20.936753 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1c81baac-3f42-44e9-87df-77340f8fb60e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:20.955932 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1c81baac-3f42-44e9-87df-77340f8fb60e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.358265 Sep 11 08:49:20.970890 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 173/354] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:20 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:21.093960 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-673ee651-f269-4961-9425-396457628d28 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:21.094675 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-673ee651-f269-4961-9425-396457628d28 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:21.099783 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7b832a3f-1ba4-458c-86d2-5ee4629fe8d7 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:21.102875 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-673ee651-f269-4961-9425-396457628d28 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:21.103612 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-673ee651-f269-4961-9425-396457628d28 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:21.104052 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-673ee651-f269-4961-9425-396457628d28 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:21.104771 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-673ee651-f269-4961-9425-396457628d28 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:21.105463 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-673ee651-f269-4961-9425-396457628d28 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:21.106137 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-673ee651-f269-4961-9425-396457628d28 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:21.117304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-7b832a3f-1ba4-458c-86d2-5ee4629fe8d7 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1508 microversion: 2.1 time: 0.295074 Sep 11 08:49:21.118578 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 182/355] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:20 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:21.276850 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-673ee651-f269-4961-9425-396457628d28 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:21.286158 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-673ee651-f269-4961-9425-396457628d28 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.195750 Sep 11 08:49:21.298537 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 174/356] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:21 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:21.365099 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:21.366465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:21.386471 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:21.388789 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:21.388789 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:21.389859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:21.390814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:21.391507 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:21.437990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:21.438828 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:21.439558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:21.440267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lazy-loading 'fault' on Instance uuid 4d2432dc-8be1-4efd-8315-9c9e07a60050 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:49:21.493003 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:21.497164 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9fb7cd78-172e-4328-8a3f-a3dfd8006c71 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:21.498055 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9fb7cd78-172e-4328-8a3f-a3dfd8006c71 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:21.504914 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb7cd78-172e-4328-8a3f-a3dfd8006c71 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:21.505287 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-08bc88a3-4c63-4018-b561-a8c087a9219b tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1303 microversion: 2.1 time: 0.149166 Sep 11 08:49:21.505700 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb7cd78-172e-4328-8a3f-a3dfd8006c71 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:21.506348 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb7cd78-172e-4328-8a3f-a3dfd8006c71 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:21.507205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb7cd78-172e-4328-8a3f-a3dfd8006c71 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:21.507780 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb7cd78-172e-4328-8a3f-a3dfd8006c71 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:21.508332 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb7cd78-172e-4328-8a3f-a3dfd8006c71 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:21.515429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 183/357] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:21 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:21.583720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9fb7cd78-172e-4328-8a3f-a3dfd8006c71 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:21.593600 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9fb7cd78-172e-4328-8a3f-a3dfd8006c71 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1274 microversion: 2.1 time: 0.100528 Sep 11 08:49:21.594400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 175/358] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:21 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:21.832083 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:21.833099 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:21.840600 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:21.841214 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:21.841746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:21.849133 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:21.849133 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:21.849133 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:21.992481 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-717b2a9e-f501-4984-902d-d1e5a369ebc6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:21.993517 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-717b2a9e-f501-4984-902d-d1e5a369ebc6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:22.001648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-717b2a9e-f501-4984-902d-d1e5a369ebc6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:22.002473 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-717b2a9e-f501-4984-902d-d1e5a369ebc6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:22.003327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-717b2a9e-f501-4984-902d-d1e5a369ebc6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:22.005046 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-717b2a9e-f501-4984-902d-d1e5a369ebc6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:22.005757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-717b2a9e-f501-4984-902d-d1e5a369ebc6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:22.006407 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-717b2a9e-f501-4984-902d-d1e5a369ebc6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:22.033760 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:22.049888 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:22.053976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:22.056387 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-af984105-9ea0-44b1-9aeb-859b81e6c0ec tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1743 microversion: 2.20 time: 0.228405 Sep 11 08:49:22.057630 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 184/359] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:21 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1743 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:22.157476 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1d378059-d6eb-463b-9362-c92bf39ad307 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:22.158260 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1d378059-d6eb-463b-9362-c92bf39ad307 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:22.166840 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1d378059-d6eb-463b-9362-c92bf39ad307 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:22.167352 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1d378059-d6eb-463b-9362-c92bf39ad307 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:22.167780 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1d378059-d6eb-463b-9362-c92bf39ad307 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:22.168504 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1d378059-d6eb-463b-9362-c92bf39ad307 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:22.168966 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1d378059-d6eb-463b-9362-c92bf39ad307 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:22.169425 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1d378059-d6eb-463b-9362-c92bf39ad307 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:22.205585 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-717b2a9e-f501-4984-902d-d1e5a369ebc6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:22.208341 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:22.217299 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-717b2a9e-f501-4984-902d-d1e5a369ebc6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.230224 Sep 11 08:49:22.225255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 176/360] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:21 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:22.329069 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-28244c87-eab5-431c-a381-e85a7a7851db tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:22.329069 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-28244c87-eab5-431c-a381-e85a7a7851db tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:22.336259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28244c87-eab5-431c-a381-e85a7a7851db tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:22.336776 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28244c87-eab5-431c-a381-e85a7a7851db tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:22.337208 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28244c87-eab5-431c-a381-e85a7a7851db tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:22.337966 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28244c87-eab5-431c-a381-e85a7a7851db tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:22.338498 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28244c87-eab5-431c-a381-e85a7a7851db tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:22.338919 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28244c87-eab5-431c-a381-e85a7a7851db tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:22.679751 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-28244c87-eab5-431c-a381-e85a7a7851db tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:22.686993 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1d378059-d6eb-463b-9362-c92bf39ad307 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:22.693450 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-28244c87-eab5-431c-a381-e85a7a7851db tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.372172 Sep 11 08:49:22.696706 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 177/361] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:22 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:22.704332 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:22.709712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:22.713294 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1d378059-d6eb-463b-9362-c92bf39ad307 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1514 microversion: 2.1 time: 0.560994 Sep 11 08:49:22.716118 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 185/362] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:22 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1514 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:22.726784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:22.738455 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7154c468-bdd2-40b0-b529-e7f6db3d314d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:22.738746 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:22.738746 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:22.738746 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:22.738746 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:22.739090 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:22.740380 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-7154c468-bdd2-40b0-b529-e7f6db3d314d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:22.748254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7154c468-bdd2-40b0-b529-e7f6db3d314d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:22.748930 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7154c468-bdd2-40b0-b529-e7f6db3d314d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:22.749791 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7154c468-bdd2-40b0-b529-e7f6db3d314d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:22.753625 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7154c468-bdd2-40b0-b529-e7f6db3d314d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:22.782874 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7154c468-bdd2-40b0-b529-e7f6db3d314d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:22.785795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7154c468-bdd2-40b0-b529-e7f6db3d314d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:22.844822 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:22.845450 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:22.849216 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:22.849780 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lazy-loading 'fault' on Instance uuid 4d2432dc-8be1-4efd-8315-9c9e07a60050 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:49:22.949138 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b198ff6ed104068b38b993054617f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead98e6e89d840a0b99273f28429b4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:22.964127 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c310c33b-5d68-4764-bbbd-052e3194b74a tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 200 len: 1303 microversion: 2.1 time: 0.265855 Sep 11 08:49:22.965952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 178/363] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:22 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 1303 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:23.087107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:23.087802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:23.101968 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:23.102681 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:23.102943 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:23.103881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:23.104529 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:23.105210 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:23.249385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7154c468-bdd2-40b0-b529-e7f6db3d314d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:23.281226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-7154c468-bdd2-40b0-b529-e7f6db3d314d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1284 microversion: 2.1 time: 0.563134 Sep 11 08:49:23.283122 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 186/364] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:22 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1284 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:23.293520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-505d93ee-dad7-44bc-9b21-d12c569b563c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:23.295440 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-505d93ee-dad7-44bc-9b21-d12c569b563c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:23.309002 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-505d93ee-dad7-44bc-9b21-d12c569b563c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:23.310411 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-505d93ee-dad7-44bc-9b21-d12c569b563c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:23.311296 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-505d93ee-dad7-44bc-9b21-d12c569b563c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:23.313130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-505d93ee-dad7-44bc-9b21-d12c569b563c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:23.313997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-505d93ee-dad7-44bc-9b21-d12c569b563c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:23.314783 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-505d93ee-dad7-44bc-9b21-d12c569b563c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:23.365781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:23.384297 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:23.387813 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:23.390437 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-86cf6c51-9f10-4541-8f32-7f3b7d708798 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.307454 Sep 11 08:49:23.407144 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 179/365] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:23 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:49:23.603431 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-505d93ee-dad7-44bc-9b21-d12c569b563c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:23.620919 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-505d93ee-dad7-44bc-9b21-d12c569b563c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.336080 Sep 11 08:49:23.622336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 187/366] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:23 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:23.720987 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-cbb3c2cd-b0bc-4181-9c2e-62763b157d1f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:23.721867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-cbb3c2cd-b0bc-4181-9c2e-62763b157d1f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:23.735982 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cbb3c2cd-b0bc-4181-9c2e-62763b157d1f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:23.736593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cbb3c2cd-b0bc-4181-9c2e-62763b157d1f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:23.741914 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cbb3c2cd-b0bc-4181-9c2e-62763b157d1f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:23.741914 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cbb3c2cd-b0bc-4181-9c2e-62763b157d1f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:23.742789 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cbb3c2cd-b0bc-4181-9c2e-62763b157d1f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:23.743478 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cbb3c2cd-b0bc-4181-9c2e-62763b157d1f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:24.027387 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:24.035663 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] [instance: 4d2432dc-8be1-4efd-8315-9c9e07a60050] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:24.075894 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-cbb3c2cd-b0bc-4181-9c2e-62763b157d1f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:24.082945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:24.089182 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:24.094962 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:24.100139 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:24.102100 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-cbb3c2cd-b0bc-4181-9c2e-62763b157d1f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.383298 Sep 11 08:49:24.104536 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 180/367] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:23 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:24.108354 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:24.109346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:24.135468 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] HTTP exception thrown: Instance 4d2432dc-8be1-4efd-8315-9c9e07a60050 could not be found. Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Request method failure captured: Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 HTTP/1.1 Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaDEm7SFsn142VCwr27oXjPEG5fY7vlKemuTWapfiRy9PT4HrOkvXxZafiApEND4N-uobc0HZezOviKmdr7H82zS_ozoBtlkU399ivArZidXV84LnGg3t40VCCFxaUXVqyrwrdbwYRiTxA_SiQeeJCG21bUAM8n8KCUM17M2gIbywbQ Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: ead98e6e89d840a0b99273f28429b4ba Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-VolumesActionsTest-1219148205 Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:49:24.138027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ead98e6e89d840a0b99273f28429b4ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ead98e6e89d840a0b99273f28429b4ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ead98e6e89d840a0b99273f28429b4ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ead98e6e89d840a0b99273f28429b4ba", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-VolumesActionsTest-1219148205 Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: ead98e6e89d840a0b99273f28429b4ba Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-VolumesActionsTest-1219148205 Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-VolumesActionsTest-1219148205-project Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 0b198ff6ed104068b38b993054617f9a Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-VolumesActionsTest-1219148205-project Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance 4d2432dc-8be1-4efd-8315-9c9e07a60050 could not be found. Sep 11 08:49:24.139779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': '4d2432dc-8be1-4efd-8315-9c9e07a60050'} Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d2432dc-8be1-4efd-8315-9c9e07a60050 could not be found. Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:49:24.140574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d2432dc-8be1-4efd-8315-9c9e07a60050 could not be found. Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d2432dc-8be1-4efd-8315-9c9e07a60050 could not be found. Sep 11 08:49:24.141997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:49:24.148479 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] Returning 404 to user: Instance 4d2432dc-8be1-4efd-8315-9c9e07a60050 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:49:24.150228 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bbbbf058-f764-43ac-a7b1-b322e8360882 tempest-VolumesActionsTest-1219148205 tempest-VolumesActionsTest-1219148205-project] 10.222.0.44 "GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050" status: 404 len: 111 microversion: 2.1 time: 0.141373 Sep 11 08:49:24.155820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 188/368] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:24 2022] GET /compute/v2.1/servers/4d2432dc-8be1-4efd-8315-9c9e07a60050 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 08:49:24.309383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c72e4efb-a80c-4739-a04f-d545872c3e90 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:24.317970 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c72e4efb-a80c-4739-a04f-d545872c3e90 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:24.324987 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c72e4efb-a80c-4739-a04f-d545872c3e90 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:24.326103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c72e4efb-a80c-4739-a04f-d545872c3e90 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:24.326819 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c72e4efb-a80c-4739-a04f-d545872c3e90 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:24.327883 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c72e4efb-a80c-4739-a04f-d545872c3e90 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:24.328591 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c72e4efb-a80c-4739-a04f-d545872c3e90 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:24.329302 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c72e4efb-a80c-4739-a04f-d545872c3e90 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:24.442480 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:24.443428 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:24.451049 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:24.451966 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:24.452563 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:24.462388 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:24.463816 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:24.469235 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:24.474882 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c72e4efb-a80c-4739-a04f-d545872c3e90 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:24.488259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c72e4efb-a80c-4739-a04f-d545872c3e90 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1272 microversion: 2.1 time: 0.183504 Sep 11 08:49:24.489425 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 181/369] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:24 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:24.650350 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-094cb70d-acd9-45d0-839d-9a20b10f1818 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:24.651555 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-094cb70d-acd9-45d0-839d-9a20b10f1818 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:24.659477 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-094cb70d-acd9-45d0-839d-9a20b10f1818 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:24.661556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-094cb70d-acd9-45d0-839d-9a20b10f1818 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:24.662479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-094cb70d-acd9-45d0-839d-9a20b10f1818 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:24.664265 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-094cb70d-acd9-45d0-839d-9a20b10f1818 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:24.664966 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-094cb70d-acd9-45d0-839d-9a20b10f1818 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:24.666614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-094cb70d-acd9-45d0-839d-9a20b10f1818 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:24.909799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:24.930652 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:24.936980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:24.939470 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bf55aff5-a9cd-4889-b2fe-81b09efe3ce8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.501809 Sep 11 08:49:24.941321 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 189/370] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:24 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:25.076450 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-094cb70d-acd9-45d0-839d-9a20b10f1818 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:25.086733 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-094cb70d-acd9-45d0-839d-9a20b10f1818 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.440603 Sep 11 08:49:25.087586 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 182/371] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:24 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:25.131150 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-776a9b0c-a101-4b7d-a2f1-0b85e919b852 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:25.132745 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-776a9b0c-a101-4b7d-a2f1-0b85e919b852 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:25.141975 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-776a9b0c-a101-4b7d-a2f1-0b85e919b852 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:25.143335 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-776a9b0c-a101-4b7d-a2f1-0b85e919b852 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:25.144009 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-776a9b0c-a101-4b7d-a2f1-0b85e919b852 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:25.145084 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-776a9b0c-a101-4b7d-a2f1-0b85e919b852 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:25.146716 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-776a9b0c-a101-4b7d-a2f1-0b85e919b852 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:25.149353 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-776a9b0c-a101-4b7d-a2f1-0b85e919b852 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:25.537624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f5a48e17-7dbf-41bd-b50f-b8e3eaba98a3 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:25.539103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f5a48e17-7dbf-41bd-b50f-b8e3eaba98a3 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:25.558995 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5a48e17-7dbf-41bd-b50f-b8e3eaba98a3 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:25.559769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5a48e17-7dbf-41bd-b50f-b8e3eaba98a3 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:25.560366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5a48e17-7dbf-41bd-b50f-b8e3eaba98a3 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:25.564315 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5a48e17-7dbf-41bd-b50f-b8e3eaba98a3 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:25.564315 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5a48e17-7dbf-41bd-b50f-b8e3eaba98a3 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:25.564315 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5a48e17-7dbf-41bd-b50f-b8e3eaba98a3 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:25.686436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-776a9b0c-a101-4b7d-a2f1-0b85e919b852 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:25.711746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-776a9b0c-a101-4b7d-a2f1-0b85e919b852 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.587190 Sep 11 08:49:25.722492 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 190/372] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:25 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:25.732448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-75d598a1-7a3f-4131-9e0e-257ae577f6bd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Action: 'create', calling method: .version_select at 0x7fb27f01cb80>, body: {"keypair": {"name": "tempest-keypair-1370435579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpU3Ro/JQuQrhAL3+v6xJ7o42fpcyknnL7Zaw8D/pCuz05EeUEUupLqKxDz3+aGpXqzU7+jua9Gx9rs3o9krDEadqMIh3XfA595koiPvn8bGYFvuuYbHW6mP0YMDs3SxA=="}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:25.775156 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-75d598a1-7a3f-4131-9e0e-257ae577f6bd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Getting quotas for project bcb554b6cf504ca9a30a1ea871364e3d. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:49:25.808277 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-75d598a1-7a3f-4131-9e0e-257ae577f6bd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Getting quotas for user 2aea4a0e0ec74c538735b890fb774b14 and project bcb554b6cf504ca9a30a1ea871364e3d. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:49:25.989505 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f5a48e17-7dbf-41bd-b50f-b8e3eaba98a3 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:26.013024 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f5a48e17-7dbf-41bd-b50f-b8e3eaba98a3 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 0.481638 Sep 11 08:49:26.014729 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 183/373] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:25 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:26.026499 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:26.028066 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:26.040041 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-75d598a1-7a3f-4131-9e0e-257ae577f6bd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.324050 Sep 11 08:49:26.042099 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 191/374] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 08:49:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:49:26.061186 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:26.061937 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:26.080559 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:26.086705 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:26.092001 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:26.092495 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:26.122112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9f187944-8400-48d3-894a-7c331bf24bf9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:26.123894 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9f187944-8400-48d3-894a-7c331bf24bf9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:26.142545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9f187944-8400-48d3-894a-7c331bf24bf9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:26.142545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9f187944-8400-48d3-894a-7c331bf24bf9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:26.142545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9f187944-8400-48d3-894a-7c331bf24bf9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:26.142545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9f187944-8400-48d3-894a-7c331bf24bf9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:26.145543 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9f187944-8400-48d3-894a-7c331bf24bf9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:26.147495 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9f187944-8400-48d3-894a-7c331bf24bf9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:26.658404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:26.689103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:26.697725 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:26.703055 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-11c54713-112e-4218-83a1-c9e3f0ed20b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.683835 Sep 11 08:49:26.704391 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 184/375] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:26 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:26.745267 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-579af207-8b60-4fd4-83de-eda906c04d8d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:26.755103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-579af207-8b60-4fd4-83de-eda906c04d8d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:26.821515 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-579af207-8b60-4fd4-83de-eda906c04d8d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:26.827729 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-579af207-8b60-4fd4-83de-eda906c04d8d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:26.828903 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-579af207-8b60-4fd4-83de-eda906c04d8d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:26.832967 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-579af207-8b60-4fd4-83de-eda906c04d8d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:26.835233 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-579af207-8b60-4fd4-83de-eda906c04d8d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:26.838852 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-579af207-8b60-4fd4-83de-eda906c04d8d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:27.192220 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-9f187944-8400-48d3-894a-7c331bf24bf9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:27.204070 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9f187944-8400-48d3-894a-7c331bf24bf9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 1.089719 Sep 11 08:49:27.207636 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 192/376] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:26 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:27.214258 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ada7185b-69f9-44b8-aa4b-9d78ebf39f21 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:27.214978 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ada7185b-69f9-44b8-aa4b-9d78ebf39f21 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:27.253456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ada7185b-69f9-44b8-aa4b-9d78ebf39f21 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:27.255270 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ada7185b-69f9-44b8-aa4b-9d78ebf39f21 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:27.258548 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ada7185b-69f9-44b8-aa4b-9d78ebf39f21 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:27.259947 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ada7185b-69f9-44b8-aa4b-9d78ebf39f21 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:27.262324 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ada7185b-69f9-44b8-aa4b-9d78ebf39f21 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:27.263423 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ada7185b-69f9-44b8-aa4b-9d78ebf39f21 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:27.543693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-579af207-8b60-4fd4-83de-eda906c04d8d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:27.558953 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-579af207-8b60-4fd4-83de-eda906c04d8d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.821495 Sep 11 08:49:27.571086 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 185/377] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:26 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:27.652668 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-0e70de70-606a-44a8-b54f-d533e5228e12 req-1645becb-158b-489a-9b08-555ab1e950f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2520cc9-8413-40ef-9b12-b5914bff16e2", "name": "network-vif-plugged", "status": "completed", "tag": "fa04f10d-c16c-4338-8893-20b0b4de7866"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:27.692236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-0e70de70-606a-44a8-b54f-d533e5228e12 req-1645becb-158b-489a-9b08-555ab1e950f0 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:27.698214 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-0e70de70-606a-44a8-b54f-d533e5228e12 req-1645becb-158b-489a-9b08-555ab1e950f0 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:27.699641 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-0e70de70-606a-44a8-b54f-d533e5228e12 req-1645becb-158b-489a-9b08-555ab1e950f0 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:27.725334 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-0e70de70-606a-44a8-b54f-d533e5228e12 req-1645becb-158b-489a-9b08-555ab1e950f0 service nova] Creating event network-vif-plugged:fa04f10d-c16c-4338-8893-20b0b4de7866 for instance a2520cc9-8413-40ef-9b12-b5914bff16e2 on hv-cinder-85694 Sep 11 08:49:27.737460 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-0e70de70-606a-44a8-b54f-d533e5228e12 req-1645becb-158b-489a-9b08-555ab1e950f0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092629 Sep 11 08:49:27.739801 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 186/378] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:49:27.766495 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:27.768333 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:27.781101 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:27.782654 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:27.783850 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:27.785623 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:27.787494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:27.788666 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:27.790835 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ada7185b-69f9-44b8-aa4b-9d78ebf39f21 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:27.806846 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ada7185b-69f9-44b8-aa4b-9d78ebf39f21 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 0.596818 Sep 11 08:49:27.817684 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 193/379] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:27 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:28.262178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-161eafb3-a0c3-4d03-bccd-f82f69a1521e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:28.264390 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-161eafb3-a0c3-4d03-bccd-f82f69a1521e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:28.278176 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:28.292631 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-161eafb3-a0c3-4d03-bccd-f82f69a1521e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:28.298701 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:28.307939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-161eafb3-a0c3-4d03-bccd-f82f69a1521e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:28.311717 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:28.313028 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-161eafb3-a0c3-4d03-bccd-f82f69a1521e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:28.314279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d357b773-048c-4880-b946-83c705280306 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.556011 Sep 11 08:49:28.315718 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 187/380] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:27 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:28.318904 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-161eafb3-a0c3-4d03-bccd-f82f69a1521e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:28.320264 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-161eafb3-a0c3-4d03-bccd-f82f69a1521e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:28.320959 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-161eafb3-a0c3-4d03-bccd-f82f69a1521e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:28.578400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-065b4e8e-8cdf-42e5-a50e-d2f5c4fc78b3 req-eeda11b7-5df3-4403-a0b0-980ae592ae7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61189881-e8ae-431a-aecb-4e45d144369c", "tag": "8ec72cc2-df78-4b92-8b63-c633c6bbe04d"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:28.621387 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-065b4e8e-8cdf-42e5-a50e-d2f5c4fc78b3 req-eeda11b7-5df3-4403-a0b0-980ae592ae7b service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:28.624658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-065b4e8e-8cdf-42e5-a50e-d2f5c4fc78b3 req-eeda11b7-5df3-4403-a0b0-980ae592ae7b service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:28.627780 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-065b4e8e-8cdf-42e5-a50e-d2f5c4fc78b3 req-eeda11b7-5df3-4403-a0b0-980ae592ae7b service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:28.679567 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-065b4e8e-8cdf-42e5-a50e-d2f5c4fc78b3 req-eeda11b7-5df3-4403-a0b0-980ae592ae7b service nova] Creating event network-changed:8ec72cc2-df78-4b92-8b63-c633c6bbe04d for instance 61189881-e8ae-431a-aecb-4e45d144369c on hv-cinder-85694 Sep 11 08:49:28.710024 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-065b4e8e-8cdf-42e5-a50e-d2f5c4fc78b3 req-eeda11b7-5df3-4403-a0b0-980ae592ae7b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138448 Sep 11 08:49:28.712915 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 188/381] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:49:28.725250 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3b5b8ca8-809c-42f5-8001-2102e9c1fdc9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:28.728466 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3b5b8ca8-809c-42f5-8001-2102e9c1fdc9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:28.743404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b5b8ca8-809c-42f5-8001-2102e9c1fdc9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:28.744649 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b5b8ca8-809c-42f5-8001-2102e9c1fdc9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:28.745670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b5b8ca8-809c-42f5-8001-2102e9c1fdc9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:28.748501 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b5b8ca8-809c-42f5-8001-2102e9c1fdc9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:28.749928 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b5b8ca8-809c-42f5-8001-2102e9c1fdc9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:28.750848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b5b8ca8-809c-42f5-8001-2102e9c1fdc9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:28.887886 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-161eafb3-a0c3-4d03-bccd-f82f69a1521e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:28.903815 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=100 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:28.929249 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-161eafb3-a0c3-4d03-bccd-f82f69a1521e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.673513 Sep 11 08:49:28.953087 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 194/382] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:28 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:28.978436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d5f5e032-f464-457c-bf1d-3fb15049b005 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:28.980324 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d5f5e032-f464-457c-bf1d-3fb15049b005 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:28.996446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f5e032-f464-457c-bf1d-3fb15049b005 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:29.002875 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f5e032-f464-457c-bf1d-3fb15049b005 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:29.002875 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f5e032-f464-457c-bf1d-3fb15049b005 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:29.002875 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f5e032-f464-457c-bf1d-3fb15049b005 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:29.002875 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f5e032-f464-457c-bf1d-3fb15049b005 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:29.003555 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5f5e032-f464-457c-bf1d-3fb15049b005 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:29.176734 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3b5b8ca8-809c-42f5-8001-2102e9c1fdc9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:29.226385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3b5b8ca8-809c-42f5-8001-2102e9c1fdc9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.485392 Sep 11 08:49:29.226385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 189/383] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:28 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:29.370814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d5f5e032-f464-457c-bf1d-3fb15049b005 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:29.370814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d5f5e032-f464-457c-bf1d-3fb15049b005 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 0.414516 Sep 11 08:49:29.372887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 195/384] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:28 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:29.407508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:29.407508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:29.409554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:29.413691 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:29.414714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:29.417778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:29.419340 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:29.422887 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:29.690269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:29.707758 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:29.712620 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:29.716174 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c32bef44-f28b-46f2-9230-e3fee5aff561 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.341301 Sep 11 08:49:29.717826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 190/385] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:29 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:29.976381 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-783c1290-9f55-409f-b6f0-e6f6b54e1d19 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:29.977000 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-783c1290-9f55-409f-b6f0-e6f6b54e1d19 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:29.984263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-783c1290-9f55-409f-b6f0-e6f6b54e1d19 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:29.984794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-783c1290-9f55-409f-b6f0-e6f6b54e1d19 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:29.985217 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-783c1290-9f55-409f-b6f0-e6f6b54e1d19 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:29.985959 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-783c1290-9f55-409f-b6f0-e6f6b54e1d19 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:29.986465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-783c1290-9f55-409f-b6f0-e6f6b54e1d19 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:29.986898 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-783c1290-9f55-409f-b6f0-e6f6b54e1d19 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:30.243668 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-783c1290-9f55-409f-b6f0-e6f6b54e1d19 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:30.254890 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-783c1290-9f55-409f-b6f0-e6f6b54e1d19 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.282387 Sep 11 08:49:30.256153 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 196/386] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:29 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:30.261000 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-333f2948-4a8e-4455-b305-3b81ac3a7277 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:30.261703 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-333f2948-4a8e-4455-b305-3b81ac3a7277 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:30.269908 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-333f2948-4a8e-4455-b305-3b81ac3a7277 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:30.270630 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-333f2948-4a8e-4455-b305-3b81ac3a7277 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:30.274365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-333f2948-4a8e-4455-b305-3b81ac3a7277 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:30.274365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-333f2948-4a8e-4455-b305-3b81ac3a7277 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:30.274365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-333f2948-4a8e-4455-b305-3b81ac3a7277 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:30.278469 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-333f2948-4a8e-4455-b305-3b81ac3a7277 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:30.519850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ffee6de8-95f1-45a2-95ad-64d4786f57f7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:30.519850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ffee6de8-95f1-45a2-95ad-64d4786f57f7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:30.519850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffee6de8-95f1-45a2-95ad-64d4786f57f7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:30.519850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffee6de8-95f1-45a2-95ad-64d4786f57f7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:30.521933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffee6de8-95f1-45a2-95ad-64d4786f57f7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:30.521933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffee6de8-95f1-45a2-95ad-64d4786f57f7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:30.521933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffee6de8-95f1-45a2-95ad-64d4786f57f7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:30.521933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffee6de8-95f1-45a2-95ad-64d4786f57f7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:30.523845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-333f2948-4a8e-4455-b305-3b81ac3a7277 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:30.523845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-333f2948-4a8e-4455-b305-3b81ac3a7277 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.222666 Sep 11 08:49:30.523845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 191/387] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:30 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:30.634232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ffee6de8-95f1-45a2-95ad-64d4786f57f7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:30.658748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ffee6de8-95f1-45a2-95ad-64d4786f57f7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 0.263638 Sep 11 08:49:30.659522 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 197/388] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:30 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:30.758402 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:30.759226 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:30.767468 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:30.767979 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:30.768472 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:30.769187 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:30.770218 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:30.770650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:30.995578 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:31.005426 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:31.010655 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:31.010655 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a4cefd98-ffd0-4083-96e8-819cbea3193c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.255719 Sep 11 08:49:31.010655 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 192/389] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:30 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:49:31.293829 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-41456fb2-1c77-4e0f-a79a-8d2c1cde7b31 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:31.295596 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-41456fb2-1c77-4e0f-a79a-8d2c1cde7b31 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:31.311265 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41456fb2-1c77-4e0f-a79a-8d2c1cde7b31 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:31.312180 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41456fb2-1c77-4e0f-a79a-8d2c1cde7b31 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:31.313006 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41456fb2-1c77-4e0f-a79a-8d2c1cde7b31 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:31.314603 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41456fb2-1c77-4e0f-a79a-8d2c1cde7b31 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:31.315847 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41456fb2-1c77-4e0f-a79a-8d2c1cde7b31 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:31.318692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41456fb2-1c77-4e0f-a79a-8d2c1cde7b31 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:31.571628 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-eef7f984-adb7-467f-951c-8e137958a009 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:31.574558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-eef7f984-adb7-467f-951c-8e137958a009 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:31.622203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eef7f984-adb7-467f-951c-8e137958a009 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:31.623139 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eef7f984-adb7-467f-951c-8e137958a009 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:31.645794 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eef7f984-adb7-467f-951c-8e137958a009 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:31.645794 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eef7f984-adb7-467f-951c-8e137958a009 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:31.645794 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eef7f984-adb7-467f-951c-8e137958a009 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:31.645794 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eef7f984-adb7-467f-951c-8e137958a009 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:31.715146 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-41456fb2-1c77-4e0f-a79a-8d2c1cde7b31 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:31.738727 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-41456fb2-1c77-4e0f-a79a-8d2c1cde7b31 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.454680 Sep 11 08:49:31.755722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 198/390] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:31 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:31.781078 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1e902718-c818-4603-ad82-2464d40fc4be tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:31.782828 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1e902718-c818-4603-ad82-2464d40fc4be tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:31.794502 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e902718-c818-4603-ad82-2464d40fc4be tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:31.795370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e902718-c818-4603-ad82-2464d40fc4be tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:31.796232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e902718-c818-4603-ad82-2464d40fc4be tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:31.797491 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e902718-c818-4603-ad82-2464d40fc4be tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:31.798456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e902718-c818-4603-ad82-2464d40fc4be tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:31.799219 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e902718-c818-4603-ad82-2464d40fc4be tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:32.135383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-eef7f984-adb7-467f-951c-8e137958a009 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:32.199629 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-eef7f984-adb7-467f-951c-8e137958a009 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.632645 Sep 11 08:49:32.201192 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 193/391] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:31 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:32.218606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:32.228056 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:32.263103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:32.263103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:32.263103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:32.271077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:32.271077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:32.271077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:32.310034 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1e902718-c818-4603-ad82-2464d40fc4be tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:32.329611 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1e902718-c818-4603-ad82-2464d40fc4be tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 0.572000 Sep 11 08:49:32.330253 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 199/392] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:31 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:32.403664 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:32.754793 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:32.777573 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:32.788759 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:32.788759 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4c486fb6-8bfb-468c-b37b-e405f2122f5f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.581185 Sep 11 08:49:32.788759 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 194/393] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:32 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:32.821152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3c887976-d343-45c9-b247-12d30757c0ed tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:32.825075 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3c887976-d343-45c9-b247-12d30757c0ed tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:32.849792 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c887976-d343-45c9-b247-12d30757c0ed tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:32.851521 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c887976-d343-45c9-b247-12d30757c0ed tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:32.852329 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c887976-d343-45c9-b247-12d30757c0ed tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:32.853729 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c887976-d343-45c9-b247-12d30757c0ed tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:32.866711 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c887976-d343-45c9-b247-12d30757c0ed tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:32.867908 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c887976-d343-45c9-b247-12d30757c0ed tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:33.166631 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3c887976-d343-45c9-b247-12d30757c0ed tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:33.193164 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3c887976-d343-45c9-b247-12d30757c0ed tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.408332 Sep 11 08:49:33.194357 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 200/394] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:32 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:33.245722 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e3ed14fa-b586-4045-b239-15fc4e4cd435 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:33.247200 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e3ed14fa-b586-4045-b239-15fc4e4cd435 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:33.264514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e3ed14fa-b586-4045-b239-15fc4e4cd435 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:33.266128 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e3ed14fa-b586-4045-b239-15fc4e4cd435 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:33.266897 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e3ed14fa-b586-4045-b239-15fc4e4cd435 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:33.267962 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e3ed14fa-b586-4045-b239-15fc4e4cd435 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:33.268730 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e3ed14fa-b586-4045-b239-15fc4e4cd435 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:33.269781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e3ed14fa-b586-4045-b239-15fc4e4cd435 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:33.372981 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-07175de6-ef49-4fef-a27c-bbb1febdd266 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:33.374288 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-07175de6-ef49-4fef-a27c-bbb1febdd266 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:33.390609 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07175de6-ef49-4fef-a27c-bbb1febdd266 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:33.391744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07175de6-ef49-4fef-a27c-bbb1febdd266 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:33.392493 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07175de6-ef49-4fef-a27c-bbb1febdd266 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:33.393609 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07175de6-ef49-4fef-a27c-bbb1febdd266 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:33.394481 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07175de6-ef49-4fef-a27c-bbb1febdd266 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:33.396011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07175de6-ef49-4fef-a27c-bbb1febdd266 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:33.737487 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e3ed14fa-b586-4045-b239-15fc4e4cd435 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:33.763378 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e3ed14fa-b586-4045-b239-15fc4e4cd435 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1358 microversion: 2.1 time: 0.522926 Sep 11 08:49:33.775405 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 195/395] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:33 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1358 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:33.848160 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:33.856898 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:33.905981 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:33.906931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:33.907747 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:33.923254 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:33.924146 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:33.924951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:34.427386 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:34.451482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:34.456369 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:34.460672 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7eb60692-d195-45d0-a1bb-07198c43f0bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.625532 Sep 11 08:49:34.462806 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 196/396] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:33 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:49:34.473312 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7120d97a-2952-4e66-9129-84db8f985455 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:34.475275 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7120d97a-2952-4e66-9129-84db8f985455 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:34.504526 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-07175de6-ef49-4fef-a27c-bbb1febdd266 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:34.537740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-07175de6-ef49-4fef-a27c-bbb1febdd266 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 1.171827 Sep 11 08:49:34.539239 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7120d97a-2952-4e66-9129-84db8f985455 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:34.540096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7120d97a-2952-4e66-9129-84db8f985455 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:34.540868 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7120d97a-2952-4e66-9129-84db8f985455 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:34.552680 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7120d97a-2952-4e66-9129-84db8f985455 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:34.553645 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7120d97a-2952-4e66-9129-84db8f985455 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:34.554473 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7120d97a-2952-4e66-9129-84db8f985455 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:34.561447 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 201/397] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:33 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:34.778353 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-380179685", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "048ca4a6-429d-4b77-b6ad-109011048383"}], "security_groups": [{"name": "tempest-securitygroup--1693916645"}], "key_name": "tempest-keypair-1370435579", "user_data": "}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:35.074013 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7120d97a-2952-4e66-9129-84db8f985455 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:35.103182 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7120d97a-2952-4e66-9129-84db8f985455 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.638496 Sep 11 08:49:35.104431 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 197/398] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:34 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:35.117157 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8b9eb1c8-a8e9-4636-96eb-a1c3b4e0cc2e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:35.125558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8b9eb1c8-a8e9-4636-96eb-a1c3b4e0cc2e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:35.149685 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b9eb1c8-a8e9-4636-96eb-a1c3b4e0cc2e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:35.150475 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b9eb1c8-a8e9-4636-96eb-a1c3b4e0cc2e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:35.151041 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b9eb1c8-a8e9-4636-96eb-a1c3b4e0cc2e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:35.151947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b9eb1c8-a8e9-4636-96eb-a1c3b4e0cc2e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:35.152731 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b9eb1c8-a8e9-4636-96eb-a1c3b4e0cc2e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:35.178430 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b9eb1c8-a8e9-4636-96eb-a1c3b4e0cc2e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:35.665579 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8b9eb1c8-a8e9-4636-96eb-a1c3b4e0cc2e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:35.706036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8b9eb1c8-a8e9-4636-96eb-a1c3b4e0cc2e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1548 microversion: 2.1 time: 0.590579 Sep 11 08:49:35.714347 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 198/399] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:35 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1548 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:35.734510 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:35.738815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:35.750901 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:35.751552 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:35.752308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:35.794508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:35.794508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:35.794508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:35.847927 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=4 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:36.029436 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:36.041546 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:36.044606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:36.046672 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0e4b12c7-d1a1-4632-948a-75aac8c34c8f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.330388 Sep 11 08:49:36.048471 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 199/400] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:35 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:36.055429 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ba3c1f5c-7558-4587-aec0-ba533cbdc8b6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:36.056506 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ba3c1f5c-7558-4587-aec0-ba533cbdc8b6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:36.064333 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba3c1f5c-7558-4587-aec0-ba533cbdc8b6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:36.065524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba3c1f5c-7558-4587-aec0-ba533cbdc8b6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:36.066994 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba3c1f5c-7558-4587-aec0-ba533cbdc8b6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:36.068026 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba3c1f5c-7558-4587-aec0-ba533cbdc8b6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:36.068722 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba3c1f5c-7558-4587-aec0-ba533cbdc8b6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:36.069492 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba3c1f5c-7558-4587-aec0-ba533cbdc8b6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:36.486191 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ba3c1f5c-7558-4587-aec0-ba533cbdc8b6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:36.504348 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ba3c1f5c-7558-4587-aec0-ba533cbdc8b6 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 0.452306 Sep 11 08:49:36.527110 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 200/401] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:36 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:36.540164 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b6d4ac92-5e5d-41e8-adf4-dfa4232e43a2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:36.541236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b6d4ac92-5e5d-41e8-adf4-dfa4232e43a2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:36.557690 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6d4ac92-5e5d-41e8-adf4-dfa4232e43a2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:36.558731 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6d4ac92-5e5d-41e8-adf4-dfa4232e43a2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:36.559422 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6d4ac92-5e5d-41e8-adf4-dfa4232e43a2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:36.560417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6d4ac92-5e5d-41e8-adf4-dfa4232e43a2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:36.561135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6d4ac92-5e5d-41e8-adf4-dfa4232e43a2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:36.561778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b6d4ac92-5e5d-41e8-adf4-dfa4232e43a2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:36.951164 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b6d4ac92-5e5d-41e8-adf4-dfa4232e43a2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:36.963289 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b6d4ac92-5e5d-41e8-adf4-dfa4232e43a2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1548 microversion: 2.1 time: 0.434578 Sep 11 08:49:36.964675 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 201/402] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:36 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1548 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:36.970677 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-97f279df-9e87-47e9-a889-e520c2f9886a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:36.971691 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-97f279df-9e87-47e9-a889-e520c2f9886a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:36.979336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97f279df-9e87-47e9-a889-e520c2f9886a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:36.982412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97f279df-9e87-47e9-a889-e520c2f9886a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:36.982412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97f279df-9e87-47e9-a889-e520c2f9886a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:36.982412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97f279df-9e87-47e9-a889-e520c2f9886a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:36.982412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97f279df-9e87-47e9-a889-e520c2f9886a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:36.983071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97f279df-9e87-47e9-a889-e520c2f9886a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:37.228310 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-97f279df-9e87-47e9-a889-e520c2f9886a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:37.267693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-97f279df-9e87-47e9-a889-e520c2f9886a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.301087 Sep 11 08:49:37.271995 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 202/403] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:36 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:37.295919 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f27958ef-9e0c-4fa3-b3f2-3b9b3469681d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:37.322619 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f27958ef-9e0c-4fa3-b3f2-3b9b3469681d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:37.324585 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f27958ef-9e0c-4fa3-b3f2-3b9b3469681d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Searching by: {'deleted': False, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180'} {{(pid=127646) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 11 08:49:37.379501 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f27958ef-9e0c-4fa3-b3f2-3b9b3469681d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:37.385212 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f27958ef-9e0c-4fa3-b3f2-3b9b3469681d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:37.386053 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f27958ef-9e0c-4fa3-b3f2-3b9b3469681d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:37.387659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f27958ef-9e0c-4fa3-b3f2-3b9b3469681d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:37.388692 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f27958ef-9e0c-4fa3-b3f2-3b9b3469681d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:37.389700 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f27958ef-9e0c-4fa3-b3f2-3b9b3469681d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:37.773724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.multi_cell_list [None req-f27958ef-9e0c-4fa3-b3f2-3b9b3469681d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127646) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 11 08:49:38.258625 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f27958ef-9e0c-4fa3-b3f2-3b9b3469681d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.981562 Sep 11 08:49:38.262081 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 203/404] 10.222.0.44 () {58 vars in 1125 bytes} [Sun Sep 11 08:49:37 2022] GET /compute/v2.1/servers => generated 343 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:49:38.288251 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:38.289847 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:38.304553 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:38.305217 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:38.306027 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:38.307931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:38.308712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:38.309482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:38.664837 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:38.679572 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:38.681311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:38.682782 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-dac1323a-0655-4518-b5d5-9f1e202ef223 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.403058 Sep 11 08:49:38.683474 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 204/405] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:38 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:38.710709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d3cc1f9f-0235-42f2-95d9-636d1e014f4b tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:38.711446 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d3cc1f9f-0235-42f2-95d9-636d1e014f4b tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:38.718034 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3cc1f9f-0235-42f2-95d9-636d1e014f4b tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:38.718557 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3cc1f9f-0235-42f2-95d9-636d1e014f4b tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:38.719007 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3cc1f9f-0235-42f2-95d9-636d1e014f4b tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:38.719739 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3cc1f9f-0235-42f2-95d9-636d1e014f4b tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:38.720197 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3cc1f9f-0235-42f2-95d9-636d1e014f4b tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:38.720616 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3cc1f9f-0235-42f2-95d9-636d1e014f4b tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:39.041559 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d3cc1f9f-0235-42f2-95d9-636d1e014f4b tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:39.070882 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d3cc1f9f-0235-42f2-95d9-636d1e014f4b tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 0.359443 Sep 11 08:49:39.070882 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 205/406] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:38 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:39.070882 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a21bfc2b-7eda-4646-b738-0ea4a960ad7c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:39.070882 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a21bfc2b-7eda-4646-b738-0ea4a960ad7c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:39.074501 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a21bfc2b-7eda-4646-b738-0ea4a960ad7c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:39.075516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a21bfc2b-7eda-4646-b738-0ea4a960ad7c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:39.076272 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a21bfc2b-7eda-4646-b738-0ea4a960ad7c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:39.077261 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a21bfc2b-7eda-4646-b738-0ea4a960ad7c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:39.077989 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a21bfc2b-7eda-4646-b738-0ea4a960ad7c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:39.078713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a21bfc2b-7eda-4646-b738-0ea4a960ad7c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:39.340279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a21bfc2b-7eda-4646-b738-0ea4a960ad7c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:39.359007 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a21bfc2b-7eda-4646-b738-0ea4a960ad7c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1548 microversion: 2.1 time: 0.298249 Sep 11 08:49:39.374362 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 206/407] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:39 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1548 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:39.374362 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-863d1662-5a46-481a-808f-c4bf404afe2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:39.374362 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-863d1662-5a46-481a-808f-c4bf404afe2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:39.374362 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:39.375681 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-863d1662-5a46-481a-808f-c4bf404afe2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:39.376350 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-863d1662-5a46-481a-808f-c4bf404afe2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:39.377054 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-863d1662-5a46-481a-808f-c4bf404afe2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:39.381488 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-863d1662-5a46-481a-808f-c4bf404afe2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:39.381488 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-863d1662-5a46-481a-808f-c4bf404afe2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:39.381488 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-863d1662-5a46-481a-808f-c4bf404afe2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:39.877279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-863d1662-5a46-481a-808f-c4bf404afe2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:39.922044 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-863d1662-5a46-481a-808f-c4bf404afe2f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.559888 Sep 11 08:49:39.934310 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 207/408] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:39 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:39.954871 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:39.957335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:39.984593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:39.985786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:39.986932 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:39.988490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:39.989922 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:39.990938 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:40.505532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:40.530133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:40.534980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:40.540159 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-40d4c24e-0041-4f94-bf58-62d7120f1cfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.603914 Sep 11 08:49:40.544302 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 208/409] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:39 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:40.555528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-df358051-7da1-4b46-94b1-44c3bba0ca1e tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:40.559832 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-df358051-7da1-4b46-94b1-44c3bba0ca1e tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:40.575992 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-df358051-7da1-4b46-94b1-44c3bba0ca1e tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:40.577056 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-df358051-7da1-4b46-94b1-44c3bba0ca1e tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:40.587601 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-df358051-7da1-4b46-94b1-44c3bba0ca1e tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:40.597484 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-df358051-7da1-4b46-94b1-44c3bba0ca1e tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:40.598473 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-df358051-7da1-4b46-94b1-44c3bba0ca1e tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:40.599652 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-df358051-7da1-4b46-94b1-44c3bba0ca1e tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:41.242574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-df358051-7da1-4b46-94b1-44c3bba0ca1e tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:41.265757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-df358051-7da1-4b46-94b1-44c3bba0ca1e tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 0.719848 Sep 11 08:49:41.267255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 209/410] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:40 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:41.310141 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2983b0cf-c892-4dd3-96d8-d5712c9126d4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:41.310790 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2983b0cf-c892-4dd3-96d8-d5712c9126d4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:41.332029 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2983b0cf-c892-4dd3-96d8-d5712c9126d4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:41.337053 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2983b0cf-c892-4dd3-96d8-d5712c9126d4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:41.338243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2983b0cf-c892-4dd3-96d8-d5712c9126d4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:41.339700 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2983b0cf-c892-4dd3-96d8-d5712c9126d4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:41.340882 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2983b0cf-c892-4dd3-96d8-d5712c9126d4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:41.341919 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2983b0cf-c892-4dd3-96d8-d5712c9126d4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:41.663223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2983b0cf-c892-4dd3-96d8-d5712c9126d4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:41.668932 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:41.716375 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2983b0cf-c892-4dd3-96d8-d5712c9126d4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1719 microversion: 2.1 time: 0.424388 Sep 11 08:49:41.735572 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 210/411] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:41 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1719 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:41.767641 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:41.779628 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:41.808484 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:41.816509 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:41.816509 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:41.830299 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:41.833138 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:41.839784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:42.303135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:42.326482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:42.333149 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:42.340866 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-08b8c3f8-9954-4323-9ddd-bd0f04a149a6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.603239 Sep 11 08:49:42.341983 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 211/412] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:41 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:42.395599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-29809a81-11a9-4788-b3b2-8c291a5a010d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:42.395599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-29809a81-11a9-4788-b3b2-8c291a5a010d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:42.445510 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29809a81-11a9-4788-b3b2-8c291a5a010d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:42.446477 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29809a81-11a9-4788-b3b2-8c291a5a010d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:42.447226 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29809a81-11a9-4788-b3b2-8c291a5a010d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:42.452740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29809a81-11a9-4788-b3b2-8c291a5a010d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:42.453678 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29809a81-11a9-4788-b3b2-8c291a5a010d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:42.454474 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29809a81-11a9-4788-b3b2-8c291a5a010d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:42.907577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-29809a81-11a9-4788-b3b2-8c291a5a010d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:42.920648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-29809a81-11a9-4788-b3b2-8c291a5a010d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 0.574801 Sep 11 08:49:42.928683 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 212/413] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:42 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:42.939617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f6ff2370-9ced-47aa-bce2-a424b327eff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb43054f-b219-4fd9-9858-486f0197f2a5"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:42.944880 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f6ff2370-9ced-47aa-bce2-a424b327eff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:42.960287 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6ff2370-9ced-47aa-bce2-a424b327eff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:42.962815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6ff2370-9ced-47aa-bce2-a424b327eff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:42.963776 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6ff2370-9ced-47aa-bce2-a424b327eff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:42.967126 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6ff2370-9ced-47aa-bce2-a424b327eff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:42.968025 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6ff2370-9ced-47aa-bce2-a424b327eff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:42.974203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6ff2370-9ced-47aa-bce2-a424b327eff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:44.530901 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=43 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:44.894427 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f6ff2370-9ced-47aa-bce2-a424b327eff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "POST /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.961243 Sep 11 08:49:44.907683 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:44.919095 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 213/414] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:49:42 2022] POST /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments => generated 194 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:49:44.946206 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1f131237-6fbf-4dc1-b859-1f9f35715a6f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:44.949855 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1f131237-6fbf-4dc1-b859-1f9f35715a6f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:44.968701 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1f131237-6fbf-4dc1-b859-1f9f35715a6f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:44.969017 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1f131237-6fbf-4dc1-b859-1f9f35715a6f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:44.969771 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1f131237-6fbf-4dc1-b859-1f9f35715a6f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:44.971094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1f131237-6fbf-4dc1-b859-1f9f35715a6f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:44.972011 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1f131237-6fbf-4dc1-b859-1f9f35715a6f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:44.972800 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1f131237-6fbf-4dc1-b859-1f9f35715a6f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:45.259783 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1f131237-6fbf-4dc1-b859-1f9f35715a6f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:45.277863 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1f131237-6fbf-4dc1-b859-1f9f35715a6f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1696 microversion: 2.1 time: 0.351421 Sep 11 08:49:45.279516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 214/415] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:44 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1696 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:45.286338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-e0613655-da5d-422c-ae68-2ad5278a597d req-ff263e87-c464-45f0-8f8f-f5f5877115a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61189881-e8ae-431a-aecb-4e45d144369c", "name": "network-vif-plugged", "status": "completed", "tag": "8ec72cc2-df78-4b92-8b63-c633c6bbe04d"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:45.304840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-e0613655-da5d-422c-ae68-2ad5278a597d req-ff263e87-c464-45f0-8f8f-f5f5877115a0 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:45.306284 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-e0613655-da5d-422c-ae68-2ad5278a597d req-ff263e87-c464-45f0-8f8f-f5f5877115a0 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:45.306969 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-e0613655-da5d-422c-ae68-2ad5278a597d req-ff263e87-c464-45f0-8f8f-f5f5877115a0 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:45.418140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-e0613655-da5d-422c-ae68-2ad5278a597d req-ff263e87-c464-45f0-8f8f-f5f5877115a0 service nova] Creating event network-vif-plugged:8ec72cc2-df78-4b92-8b63-c633c6bbe04d for instance 61189881-e8ae-431a-aecb-4e45d144369c on hv-cinder-85694 Sep 11 08:49:45.436172 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-e0613655-da5d-422c-ae68-2ad5278a597d req-ff263e87-c464-45f0-8f8f-f5f5877115a0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154532 Sep 11 08:49:45.439400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 215/416] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:49:45.467897 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:45.472251 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:45.487528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:45.489599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:45.490895 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:45.492778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:45.494199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:45.495903 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:46.171170 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:46.185652 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:46.191774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:46.193170 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d0600240-85a5-4cef-a1bd-0a0eab426c7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.738669 Sep 11 08:49:46.193767 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 216/417] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:45 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:46.233940 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0cdc3d77-ceae-42ea-bb99-2381debc72ea tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:46.236142 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0cdc3d77-ceae-42ea-bb99-2381debc72ea tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:46.252222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0cdc3d77-ceae-42ea-bb99-2381debc72ea tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:46.274952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0cdc3d77-ceae-42ea-bb99-2381debc72ea tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:46.274952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0cdc3d77-ceae-42ea-bb99-2381debc72ea tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:46.274952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0cdc3d77-ceae-42ea-bb99-2381debc72ea tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:46.274952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0cdc3d77-ceae-42ea-bb99-2381debc72ea tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:46.275381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0cdc3d77-ceae-42ea-bb99-2381debc72ea tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:46.519604 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0cdc3d77-ceae-42ea-bb99-2381debc72ea tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:46.527748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0cdc3d77-ceae-42ea-bb99-2381debc72ea tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 0.306707 Sep 11 08:49:46.528331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 217/418] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:46 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:46.532971 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ee933199-e043-4c5a-84f0-2d5f407aabf7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:46.539708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ee933199-e043-4c5a-84f0-2d5f407aabf7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:46.540198 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ee933199-e043-4c5a-84f0-2d5f407aabf7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:46.540659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ee933199-e043-4c5a-84f0-2d5f407aabf7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:46.606826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ee933199-e043-4c5a-84f0-2d5f407aabf7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Going to try to start instance {{(pid=127646) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 11 08:49:46.959342 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ee933199-e043-4c5a-84f0-2d5f407aabf7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "POST /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/action" status: 202 len: 0 microversion: 2.1 time: 0.429456 Sep 11 08:49:46.959990 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 218/419] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:49:46 2022] POST /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:49:46.969514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-400209d2-c7e8-4d73-9bcb-45139a78f874 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:46.970480 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-400209d2-c7e8-4d73-9bcb-45139a78f874 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:46.977777 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-400209d2-c7e8-4d73-9bcb-45139a78f874 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:46.978408 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-400209d2-c7e8-4d73-9bcb-45139a78f874 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:46.978965 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-400209d2-c7e8-4d73-9bcb-45139a78f874 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:46.979678 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-400209d2-c7e8-4d73-9bcb-45139a78f874 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:46.980221 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-400209d2-c7e8-4d73-9bcb-45139a78f874 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:46.980676 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-400209d2-c7e8-4d73-9bcb-45139a78f874 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:47.375874 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-400209d2-c7e8-4d73-9bcb-45139a78f874 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:47.395535 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-400209d2-c7e8-4d73-9bcb-45139a78f874 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1705 microversion: 2.1 time: 0.430636 Sep 11 08:49:47.412336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 219/420] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:46 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1705 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:47.477478 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:47.490943 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:47.566399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:47.570899 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:47.571795 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:47.573160 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:47.587778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:47.588642 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:47.590849 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:47.950656 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:47.965843 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:47.970159 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:47.971550 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-051682cb-9255-4c9d-a2fd-d0b7d0c9ad18 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.552970 Sep 11 08:49:47.972845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 220/421] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:47 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:47.981674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1c63f7c2-a565-4ffc-b9ee-3ae93f4142e5 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:47.982600 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1c63f7c2-a565-4ffc-b9ee-3ae93f4142e5 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:48.001570 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c63f7c2-a565-4ffc-b9ee-3ae93f4142e5 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:48.002527 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c63f7c2-a565-4ffc-b9ee-3ae93f4142e5 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:48.003155 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c63f7c2-a565-4ffc-b9ee-3ae93f4142e5 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:48.004004 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c63f7c2-a565-4ffc-b9ee-3ae93f4142e5 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:48.004593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c63f7c2-a565-4ffc-b9ee-3ae93f4142e5 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:48.005135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c63f7c2-a565-4ffc-b9ee-3ae93f4142e5 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:48.235179 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1c63f7c2-a565-4ffc-b9ee-3ae93f4142e5 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:48.260710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1c63f7c2-a565-4ffc-b9ee-3ae93f4142e5 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1314 microversion: 2.1 time: 0.281154 Sep 11 08:49:48.264702 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 221/422] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:47 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:48.433901 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9db745f5-964a-47e8-b8bd-a6d509b3a062 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:48.436630 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9db745f5-964a-47e8-b8bd-a6d509b3a062 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:48.468884 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9db745f5-964a-47e8-b8bd-a6d509b3a062 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:48.469755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9db745f5-964a-47e8-b8bd-a6d509b3a062 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:48.471907 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9db745f5-964a-47e8-b8bd-a6d509b3a062 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:48.473825 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9db745f5-964a-47e8-b8bd-a6d509b3a062 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:48.475807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9db745f5-964a-47e8-b8bd-a6d509b3a062 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:48.477602 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9db745f5-964a-47e8-b8bd-a6d509b3a062 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:48.899556 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.network.neutron [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] validate_networks() for [('048ca4a6-429d-4b77-b6ad-109011048383', None, None, None, None, None)] {{(pid=127647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:49:48.912852 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9db745f5-964a-47e8-b8bd-a6d509b3a062 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:48.929945 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9db745f5-964a-47e8-b8bd-a6d509b3a062 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1705 microversion: 2.1 time: 0.514692 Sep 11 08:49:48.931222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 222/423] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:48 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1705 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:49.002376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:49.003446 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:49.015254 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:49.015838 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:49.016411 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:49.017221 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:49.017699 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:49.040451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:49.286551 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:49.296182 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:49.297752 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:49.299139 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-87ca905a-8a9b-459e-a24c-d63994a5bc1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1738 microversion: 2.20 time: 0.303169 Sep 11 08:49:49.301861 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 223/424] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:48 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:49:49.305884 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-17e230b2-d890-43c1-ad45-833e56f65c39 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:49.306624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-17e230b2-d890-43c1-ad45-833e56f65c39 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:49.322476 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e230b2-d890-43c1-ad45-833e56f65c39 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:49.322983 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e230b2-d890-43c1-ad45-833e56f65c39 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:49.323424 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e230b2-d890-43c1-ad45-833e56f65c39 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:49.324797 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e230b2-d890-43c1-ad45-833e56f65c39 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:49.325341 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e230b2-d890-43c1-ad45-833e56f65c39 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:49.325981 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e230b2-d890-43c1-ad45-833e56f65c39 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:49.544582 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-17e230b2-d890-43c1-ad45-833e56f65c39 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:49.553624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-17e230b2-d890-43c1-ad45-833e56f65c39 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1464 microversion: 2.1 time: 0.251891 Sep 11 08:49:49.554460 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 224/425] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:49 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1464 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:49.635749 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-bdac48d2-2691-42a8-9df6-afbb81f14541 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:49.636257 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-bdac48d2-2691-42a8-9df6-afbb81f14541 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:49.647019 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdac48d2-2691-42a8-9df6-afbb81f14541 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:49.651225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdac48d2-2691-42a8-9df6-afbb81f14541 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:49.655328 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdac48d2-2691-42a8-9df6-afbb81f14541 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:49.655328 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdac48d2-2691-42a8-9df6-afbb81f14541 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:49.655328 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdac48d2-2691-42a8-9df6-afbb81f14541 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:49.655328 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdac48d2-2691-42a8-9df6-afbb81f14541 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:49.703346 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-bdac48d2-2691-42a8-9df6-afbb81f14541 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Going to try to terminate instance {{(pid=127646) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:49:49.705888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:49:50.167178 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-bdac48d2-2691-42a8-9df6-afbb81f14541 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "DELETE /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 204 len: 0 microversion: 2.1 time: 0.531998 Sep 11 08:49:50.170331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 225/426] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:49:49 2022] DELETE /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 08:49:50.183089 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-357e6fe6-5afc-4927-9699-196f388473e4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:50.184158 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-357e6fe6-5afc-4927-9699-196f388473e4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:50.193503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357e6fe6-5afc-4927-9699-196f388473e4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:50.194561 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357e6fe6-5afc-4927-9699-196f388473e4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:50.195105 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357e6fe6-5afc-4927-9699-196f388473e4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:50.196143 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357e6fe6-5afc-4927-9699-196f388473e4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:50.196778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357e6fe6-5afc-4927-9699-196f388473e4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:50.197331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-357e6fe6-5afc-4927-9699-196f388473e4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:50.408464 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-357e6fe6-5afc-4927-9699-196f388473e4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:50.420003 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-357e6fe6-5afc-4927-9699-196f388473e4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1705 microversion: 2.1 time: 0.247654 Sep 11 08:49:50.430201 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 226/427] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:50 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1705 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:50.430201 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b5e277b4-33c3-4b42-b657-379382708e00 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:50.430201 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b5e277b4-33c3-4b42-b657-379382708e00 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:50.438915 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5e277b4-33c3-4b42-b657-379382708e00 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:50.438915 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5e277b4-33c3-4b42-b657-379382708e00 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:50.438915 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5e277b4-33c3-4b42-b657-379382708e00 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:50.438915 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5e277b4-33c3-4b42-b657-379382708e00 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:50.439528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5e277b4-33c3-4b42-b657-379382708e00 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:50.439528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5e277b4-33c3-4b42-b657-379382708e00 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:50.548727 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Flavor limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:49:50.554386 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Image limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:49:50.554927 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Flavor pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:49:50.560551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Image pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:49:50.561411 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:49:50.603284 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:50.606704 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:50.607210 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:50.608275 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:50.608741 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:50.609163 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:50.649591 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Getting quotas for project bcb554b6cf504ca9a30a1ea871364e3d. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:49:50.658739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Getting quotas for user 2aea4a0e0ec74c538735b890fb774b14 and project bcb554b6cf504ca9a30a1ea871364e3d. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:49:50.683638 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Going to run 1 instances... {{(pid=127647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:49:50.689854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:49:50.727989 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b5e277b4-33c3-4b42-b657-379382708e00 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:50.743118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b5e277b4-33c3-4b42-b657-379382708e00 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1470 microversion: 2.1 time: 0.321117 Sep 11 08:49:50.758183 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 227/428] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:50 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1470 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:50.758183 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:50.758183 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:50.774121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:50.776096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:50.776537 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:50.779736 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:50.780568 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:50.781261 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:50.975396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-368b3013-51ff-46b0-b92a-00db1464d3cc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 16.207987 Sep 11 08:49:50.991407 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 202/429] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:49:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 16216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:49:51.002382 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:51.005531 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a6c5d529-0145-4dcd-a627-98aa7b825e86 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:51.006370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a6c5d529-0145-4dcd-a627-98aa7b825e86 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:51.029601 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:51.031521 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:51.033336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c9e016c3-c35d-4186-9ef8-e5d81e58dc2f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1720 microversion: 2.20 time: 0.288396 Sep 11 08:49:51.034242 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 228/430] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:50 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1720 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:51.113275 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a6c5d529-0145-4dcd-a627-98aa7b825e86 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:51.122277 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a6c5d529-0145-4dcd-a627-98aa7b825e86 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1245 microversion: 2.1 time: 0.129069 Sep 11 08:49:51.123704 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 203/431] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:50 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1245 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:51.209667 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ed59e04b-a79c-413b-afb5-1259d4f9ece3 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:51.209667 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ed59e04b-a79c-413b-afb5-1259d4f9ece3 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:51.219884 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ed59e04b-a79c-413b-afb5-1259d4f9ece3 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:51.220484 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ed59e04b-a79c-413b-afb5-1259d4f9ece3 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:51.220995 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ed59e04b-a79c-413b-afb5-1259d4f9ece3 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:51.222716 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ed59e04b-a79c-413b-afb5-1259d4f9ece3 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:51.223283 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ed59e04b-a79c-413b-afb5-1259d4f9ece3 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:51.223803 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ed59e04b-a79c-413b-afb5-1259d4f9ece3 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:51.467376 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-98819c6f-79d6-4f84-9d0e-1fa0dc391fa5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:51.467519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ed59e04b-a79c-413b-afb5-1259d4f9ece3 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:51.468190 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-98819c6f-79d6-4f84-9d0e-1fa0dc391fa5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:51.478262 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-98819c6f-79d6-4f84-9d0e-1fa0dc391fa5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:51.481357 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ed59e04b-a79c-413b-afb5-1259d4f9ece3 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1594 microversion: 2.1 time: 0.286931 Sep 11 08:49:51.482235 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 229/432] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:51 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1594 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:51.493281 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-98819c6f-79d6-4f84-9d0e-1fa0dc391fa5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:51.493702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-98819c6f-79d6-4f84-9d0e-1fa0dc391fa5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:51.494664 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-98819c6f-79d6-4f84-9d0e-1fa0dc391fa5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:51.495275 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-98819c6f-79d6-4f84-9d0e-1fa0dc391fa5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:51.495885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-98819c6f-79d6-4f84-9d0e-1fa0dc391fa5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:51.791347 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c91bcd71-de63-45a5-9598-e14019ff0b40 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:51.804681 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c91bcd71-de63-45a5-9598-e14019ff0b40 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:51.835105 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c91bcd71-de63-45a5-9598-e14019ff0b40 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:51.840116 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c91bcd71-de63-45a5-9598-e14019ff0b40 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:51.841458 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c91bcd71-de63-45a5-9598-e14019ff0b40 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:51.842507 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-98819c6f-79d6-4f84-9d0e-1fa0dc391fa5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:51.845782 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c91bcd71-de63-45a5-9598-e14019ff0b40 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:51.849306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c91bcd71-de63-45a5-9598-e14019ff0b40 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:51.855576 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c91bcd71-de63-45a5-9598-e14019ff0b40 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:51.893209 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-98819c6f-79d6-4f84-9d0e-1fa0dc391fa5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1705 microversion: 2.1 time: 0.425521 Sep 11 08:49:51.907113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 204/433] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:51 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1705 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:52.065769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:52.066681 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:52.087666 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:52.088545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:52.089282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:52.091002 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:52.091813 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:52.095009 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:52.278666 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c91bcd71-de63-45a5-9598-e14019ff0b40 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:52.293005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c91bcd71-de63-45a5-9598-e14019ff0b40 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1470 microversion: 2.1 time: 0.522336 Sep 11 08:49:52.297657 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 230/434] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:51 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1470 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:52.337960 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8d9a3d0c-2316-4974-b0ae-46a137736ec5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:52.346234 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8d9a3d0c-2316-4974-b0ae-46a137736ec5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:52.468455 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8d9a3d0c-2316-4974-b0ae-46a137736ec5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:52.477909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8d9a3d0c-2316-4974-b0ae-46a137736ec5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1245 microversion: 2.1 time: 0.168575 Sep 11 08:49:52.507447 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 231/435] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:52 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1245 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:52.523855 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-52c00a02-2040-41c9-b022-a081cbbbc0ac req-3c6c8d06-90dc-4367-80e7-20b8b634b702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223e4b7b-8a6c-4647-aa91-aae73dbeb340", "name": "network-vif-unplugged", "status": "completed", "tag": "a3c9ee62-2858-49c8-b169-41636e1c8bdd"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:52.535517 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-52c00a02-2040-41c9-b022-a081cbbbc0ac req-3c6c8d06-90dc-4367-80e7-20b8b634b702 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:52.546959 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-52c00a02-2040-41c9-b022-a081cbbbc0ac req-3c6c8d06-90dc-4367-80e7-20b8b634b702 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:52.546959 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-52c00a02-2040-41c9-b022-a081cbbbc0ac req-3c6c8d06-90dc-4367-80e7-20b8b634b702 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:52.553826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-52c00a02-2040-41c9-b022-a081cbbbc0ac req-3c6c8d06-90dc-4367-80e7-20b8b634b702 service nova] Creating event network-vif-unplugged:a3c9ee62-2858-49c8-b169-41636e1c8bdd for instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 on hv-cinder-85694 Sep 11 08:49:52.560398 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-52c00a02-2040-41c9-b022-a081cbbbc0ac req-3c6c8d06-90dc-4367-80e7-20b8b634b702 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040331 Sep 11 08:49:52.561735 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 232/436] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:49:52.661748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:52.681515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:52.688856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:52.690092 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b65558fd-17e4-47e2-805d-c30162286a8d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1720 microversion: 2.20 time: 0.630325 Sep 11 08:49:52.706557 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 205/437] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:52 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1720 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:52.943906 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c06d9031-ffde-4176-b3ec-ed4f98b64abc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:52.945534 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c06d9031-ffde-4176-b3ec-ed4f98b64abc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:52.953014 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c06d9031-ffde-4176-b3ec-ed4f98b64abc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:52.953514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c06d9031-ffde-4176-b3ec-ed4f98b64abc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:52.953948 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c06d9031-ffde-4176-b3ec-ed4f98b64abc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:52.954727 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c06d9031-ffde-4176-b3ec-ed4f98b64abc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:52.955382 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c06d9031-ffde-4176-b3ec-ed4f98b64abc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:52.956677 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c06d9031-ffde-4176-b3ec-ed4f98b64abc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:53.359259 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-112137d9-70b6-4910-b648-4ddc9d1d804c tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:53.359259 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-112137d9-70b6-4910-b648-4ddc9d1d804c tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:53.380535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-112137d9-70b6-4910-b648-4ddc9d1d804c tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:53.381400 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-112137d9-70b6-4910-b648-4ddc9d1d804c tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:53.381991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-112137d9-70b6-4910-b648-4ddc9d1d804c tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:53.389339 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-112137d9-70b6-4910-b648-4ddc9d1d804c tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:53.390282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-112137d9-70b6-4910-b648-4ddc9d1d804c tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:53.390958 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-112137d9-70b6-4910-b648-4ddc9d1d804c tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:53.883739 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c06d9031-ffde-4176-b3ec-ed4f98b64abc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:53.932457 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c06d9031-ffde-4176-b3ec-ed4f98b64abc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1705 microversion: 2.1 time: 0.997348 Sep 11 08:49:53.937522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 233/438] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:52 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1705 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:53.954413 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-acea2b1a-b3d7-4e1a-bf9c-6442d386b01f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:53.954413 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-acea2b1a-b3d7-4e1a-bf9c-6442d386b01f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:53.966928 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-acea2b1a-b3d7-4e1a-bf9c-6442d386b01f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:53.968242 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-acea2b1a-b3d7-4e1a-bf9c-6442d386b01f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:53.970770 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-acea2b1a-b3d7-4e1a-bf9c-6442d386b01f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:53.973417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-acea2b1a-b3d7-4e1a-bf9c-6442d386b01f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:53.974755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-acea2b1a-b3d7-4e1a-bf9c-6442d386b01f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:53.975869 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-acea2b1a-b3d7-4e1a-bf9c-6442d386b01f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:54.035340 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-112137d9-70b6-4910-b648-4ddc9d1d804c tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:54.093647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-112137d9-70b6-4910-b648-4ddc9d1d804c tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1470 microversion: 2.1 time: 0.755808 Sep 11 08:49:54.099459 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 206/439] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:53 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1470 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:54.132033 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:54.137274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:54.179763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:54.181026 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:54.183378 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:54.194128 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:54.197954 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:54.199465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:54.449123 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-acea2b1a-b3d7-4e1a-bf9c-6442d386b01f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:54.481161 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-acea2b1a-b3d7-4e1a-bf9c-6442d386b01f tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1241 microversion: 2.1 time: 0.540981 Sep 11 08:49:54.483500 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 234/440] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:53 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1241 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:54.521111 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-5891e33f-3c7c-44bb-976a-707ecc4ba9e6 req-48f1cba5-7d67-4371-a733-380e6e7ec41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61189881-e8ae-431a-aecb-4e45d144369c", "name": "network-vif-deleted", "tag": "8ec72cc2-df78-4b92-8b63-c633c6bbe04d"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:54.552873 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-5891e33f-3c7c-44bb-976a-707ecc4ba9e6 req-48f1cba5-7d67-4371-a733-380e6e7ec41e service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:54.557394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-5891e33f-3c7c-44bb-976a-707ecc4ba9e6 req-48f1cba5-7d67-4371-a733-380e6e7ec41e service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:54.562753 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-5891e33f-3c7c-44bb-976a-707ecc4ba9e6 req-48f1cba5-7d67-4371-a733-380e6e7ec41e service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:54.589888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-5891e33f-3c7c-44bb-976a-707ecc4ba9e6 req-48f1cba5-7d67-4371-a733-380e6e7ec41e service nova] Creating event network-vif-deleted:8ec72cc2-df78-4b92-8b63-c633c6bbe04d for instance 61189881-e8ae-431a-aecb-4e45d144369c on hv-cinder-85694 Sep 11 08:49:54.608954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-5891e33f-3c7c-44bb-976a-707ecc4ba9e6 req-48f1cba5-7d67-4371-a733-380e6e7ec41e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110006 Sep 11 08:49:54.610426 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 235/441] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:49:54.835792 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:54.849030 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:54.851089 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:54.852289 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f89a36a9-5276-45b4-b031-271f8b66d233 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1720 microversion: 2.20 time: 0.750335 Sep 11 08:49:54.867080 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 207/442] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:54 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1720 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:54.970356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e125a64c-aff1-4135-9926-5ee3adfe5707 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:54.971207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e125a64c-aff1-4135-9926-5ee3adfe5707 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:54.984159 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e125a64c-aff1-4135-9926-5ee3adfe5707 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:54.985560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e125a64c-aff1-4135-9926-5ee3adfe5707 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:54.986952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e125a64c-aff1-4135-9926-5ee3adfe5707 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:54.988255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e125a64c-aff1-4135-9926-5ee3adfe5707 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:54.989570 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e125a64c-aff1-4135-9926-5ee3adfe5707 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:54.990357 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e125a64c-aff1-4135-9926-5ee3adfe5707 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:55.161236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e125a64c-aff1-4135-9926-5ee3adfe5707 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:55.164672 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e7fcae83-6d06-4bb3-a073-cc231eb07f50 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:55.176286 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e7fcae83-6d06-4bb3-a073-cc231eb07f50 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:55.176542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e125a64c-aff1-4135-9926-5ee3adfe5707 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1709 microversion: 2.1 time: 0.211139 Sep 11 08:49:55.176542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 236/443] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:54 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1709 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:55.197734 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e7fcae83-6d06-4bb3-a073-cc231eb07f50 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:55.198445 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e7fcae83-6d06-4bb3-a073-cc231eb07f50 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:55.199003 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e7fcae83-6d06-4bb3-a073-cc231eb07f50 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:55.199946 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e7fcae83-6d06-4bb3-a073-cc231eb07f50 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:55.200539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e7fcae83-6d06-4bb3-a073-cc231eb07f50 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:55.200978 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e7fcae83-6d06-4bb3-a073-cc231eb07f50 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:55.335968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e7fcae83-6d06-4bb3-a073-cc231eb07f50 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:55.357443 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e7fcae83-6d06-4bb3-a073-cc231eb07f50 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1428 microversion: 2.1 time: 0.205373 Sep 11 08:49:55.380692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 208/444] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:55 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1428 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:55.574427 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f8998279-15b5-4b73-ad98-a713390dc2ea tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:55.575272 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f8998279-15b5-4b73-ad98-a713390dc2ea tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:55.583201 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8998279-15b5-4b73-ad98-a713390dc2ea tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:55.584020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8998279-15b5-4b73-ad98-a713390dc2ea tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:55.584635 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8998279-15b5-4b73-ad98-a713390dc2ea tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:55.587389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8998279-15b5-4b73-ad98-a713390dc2ea tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:55.588101 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8998279-15b5-4b73-ad98-a713390dc2ea tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:55.588708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8998279-15b5-4b73-ad98-a713390dc2ea tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:55.665674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f8998279-15b5-4b73-ad98-a713390dc2ea tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:55.677406 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f8998279-15b5-4b73-ad98-a713390dc2ea tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1241 microversion: 2.1 time: 0.146516 Sep 11 08:49:55.677406 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 237/445] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:55 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:55.892844 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:55.895952 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:55.919122 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:55.919974 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:55.920747 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:55.922031 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:55.922909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:55.923884 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:56.312409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:56.343720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:56.346030 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:56.348911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9844833b-4377-4ec6-8ddf-335734956470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1720 microversion: 2.20 time: 0.467535 Sep 11 08:49:56.348911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 209/446] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:55 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1720 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:56.406651 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ca374057-229f-4b0e-b3d1-2057398e937d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:56.408766 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ca374057-229f-4b0e-b3d1-2057398e937d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:56.417981 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca374057-229f-4b0e-b3d1-2057398e937d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:56.418942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca374057-229f-4b0e-b3d1-2057398e937d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:56.419601 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca374057-229f-4b0e-b3d1-2057398e937d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:56.420705 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca374057-229f-4b0e-b3d1-2057398e937d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:56.421388 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca374057-229f-4b0e-b3d1-2057398e937d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:56.422008 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca374057-229f-4b0e-b3d1-2057398e937d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:56.507040 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ca374057-229f-4b0e-b3d1-2057398e937d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:56.516649 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ca374057-229f-4b0e-b3d1-2057398e937d tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1428 microversion: 2.1 time: 0.114283 Sep 11 08:49:56.527075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 238/447] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:56 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:56.716667 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-77d1d908-19c8-4446-9e45-1b3959fa5cd4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:56.721903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-77d1d908-19c8-4446-9e45-1b3959fa5cd4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:56.749254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77d1d908-19c8-4446-9e45-1b3959fa5cd4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:56.749254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77d1d908-19c8-4446-9e45-1b3959fa5cd4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:56.749254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77d1d908-19c8-4446-9e45-1b3959fa5cd4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:56.749254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77d1d908-19c8-4446-9e45-1b3959fa5cd4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:56.754401 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77d1d908-19c8-4446-9e45-1b3959fa5cd4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:56.755214 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77d1d908-19c8-4446-9e45-1b3959fa5cd4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:56.877587 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-77d1d908-19c8-4446-9e45-1b3959fa5cd4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:56.888037 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-77d1d908-19c8-4446-9e45-1b3959fa5cd4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1241 microversion: 2.1 time: 0.175366 Sep 11 08:49:56.898799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 210/448] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:56 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1241 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:56.998519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-030e0c6b-fce9-48cd-9f21-e2510555b649 req-79aafd2c-0a41-4bbe-acfe-40001e6caf31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2520cc9-8413-40ef-9b12-b5914bff16e2", "tag": "fa04f10d-c16c-4338-8893-20b0b4de7866"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:49:57.023669 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-030e0c6b-fce9-48cd-9f21-e2510555b649 req-79aafd2c-0a41-4bbe-acfe-40001e6caf31 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:57.024149 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-030e0c6b-fce9-48cd-9f21-e2510555b649 req-79aafd2c-0a41-4bbe-acfe-40001e6caf31 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:57.036322 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-030e0c6b-fce9-48cd-9f21-e2510555b649 req-79aafd2c-0a41-4bbe-acfe-40001e6caf31 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:57.089135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-030e0c6b-fce9-48cd-9f21-e2510555b649 req-79aafd2c-0a41-4bbe-acfe-40001e6caf31 service nova] Creating event network-changed:fa04f10d-c16c-4338-8893-20b0b4de7866 for instance a2520cc9-8413-40ef-9b12-b5914bff16e2 on hv-cinder-85694 Sep 11 08:49:57.099053 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-030e0c6b-fce9-48cd-9f21-e2510555b649 req-79aafd2c-0a41-4bbe-acfe-40001e6caf31 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112189 Sep 11 08:49:57.099684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 239/449] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:49:57.374904 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:57.375920 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:57.394299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:57.395066 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:57.409841 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:57.414320 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:57.415012 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:57.415623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:57.543603 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:57.545331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:57.565259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:57.566441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:57.570681 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:57.571763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:57.574502 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:57.577896 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:57.699705 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:57.700217 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:57.700666 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:57.710528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lazy-loading 'fault' on Instance uuid 61189881-e8ae-431a-aecb-4e45d144369c {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:49:57.931917 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:57.959407 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:57.963401 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:57.966419 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d737325d-b4e4-4cc3-a9cd-7eb55d090467 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1720 microversion: 2.20 time: 0.595289 Sep 11 08:49:57.968267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 211/450] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:57 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1720 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:57.986428 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-aca9c2a6-816d-4237-89d3-b588dffc0e0a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:57.996017 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-aca9c2a6-816d-4237-89d3-b588dffc0e0a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:58.010512 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aca9c2a6-816d-4237-89d3-b588dffc0e0a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:58.011692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aca9c2a6-816d-4237-89d3-b588dffc0e0a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:58.013921 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aca9c2a6-816d-4237-89d3-b588dffc0e0a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:58.015958 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aca9c2a6-816d-4237-89d3-b588dffc0e0a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:58.016687 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aca9c2a6-816d-4237-89d3-b588dffc0e0a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:58.019049 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aca9c2a6-816d-4237-89d3-b588dffc0e0a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:58.093492 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:58.117163 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1c3b59a2-ae53-4892-9f67-4af8f0539411 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1304 microversion: 2.1 time: 0.578513 Sep 11 08:49:58.119562 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 240/451] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:57 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1304 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:58.295512 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-aca9c2a6-816d-4237-89d3-b588dffc0e0a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:58.311237 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-aca9c2a6-816d-4237-89d3-b588dffc0e0a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1297 microversion: 2.1 time: 0.338478 Sep 11 08:49:58.313589 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 212/452] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:57 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1297 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:49:59.022444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:59.022444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:59.053659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:59.053659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:59.053659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:59.054082 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:59.054402 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:59.054831 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:59.146623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:59.147906 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:59.159701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:59.163153 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:59.163833 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:59.164593 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:59.165053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:59.165481 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:59.206107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:59.207861 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:59.209177 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:59.210039 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lazy-loading 'fault' on Instance uuid 61189881-e8ae-431a-aecb-4e45d144369c {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:49:59.323384 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:59.339516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c293b0e6-7525-473d-8c66-ec3236887588 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1304 microversion: 2.1 time: 0.197195 Sep 11 08:49:59.340128 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 213/453] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:59 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:49:59.359639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-df3e20dc-bcdc-420d-8f95-e10f2da03ffc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:49:59.360568 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-df3e20dc-bcdc-420d-8f95-e10f2da03ffc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:49:59.367912 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-df3e20dc-bcdc-420d-8f95-e10f2da03ffc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:59.368743 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-df3e20dc-bcdc-420d-8f95-e10f2da03ffc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:59.369377 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-df3e20dc-bcdc-420d-8f95-e10f2da03ffc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:59.370372 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-df3e20dc-bcdc-420d-8f95-e10f2da03ffc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:49:59.371052 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-df3e20dc-bcdc-420d-8f95-e10f2da03ffc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:49:59.379225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-df3e20dc-bcdc-420d-8f95-e10f2da03ffc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:49:59.472891 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:59.490957 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:59.494407 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:59.497017 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-40634cc5-4b6f-4032-8af8-257f338d9d01 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1720 microversion: 2.20 time: 0.484330 Sep 11 08:49:59.498314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 241/454] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:49:59 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1720 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:49:59.514596 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-df3e20dc-bcdc-420d-8f95-e10f2da03ffc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:49:59.528975 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-df3e20dc-bcdc-420d-8f95-e10f2da03ffc tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1297 microversion: 2.1 time: 0.173022 Sep 11 08:49:59.531133 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 214/455] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:49:59 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1297 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:00.364388 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:00.365532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:00.390545 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:00.394841 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:00.396412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:00.402449 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:00.403478 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:00.404293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:00.487955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:00.488815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:00.489797 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:00.490743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lazy-loading 'fault' on Instance uuid 61189881-e8ae-431a-aecb-4e45d144369c {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:50:00.529952 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:00.531101 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:00.550591 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:00.550591 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:00.550591 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:00.550591 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:00.551525 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:00.551525 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:00.570237 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:00.587447 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f6a9b601-7c47-4187-9117-ff439272a5b7 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1304 microversion: 2.1 time: 0.227525 Sep 11 08:50:00.602715 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 242/456] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:00 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1304 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:00.610742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-11ffa97b-b439-4dd1-95a0-00ae5b51418a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:00.611687 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-11ffa97b-b439-4dd1-95a0-00ae5b51418a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:00.618942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11ffa97b-b439-4dd1-95a0-00ae5b51418a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:00.619699 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11ffa97b-b439-4dd1-95a0-00ae5b51418a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:00.620336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11ffa97b-b439-4dd1-95a0-00ae5b51418a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:00.621305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11ffa97b-b439-4dd1-95a0-00ae5b51418a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:00.621935 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11ffa97b-b439-4dd1-95a0-00ae5b51418a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:00.622756 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11ffa97b-b439-4dd1-95a0-00ae5b51418a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:00.629393 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:00.649067 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:00.754497 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-11ffa97b-b439-4dd1-95a0-00ae5b51418a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:00.773529 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-11ffa97b-b439-4dd1-95a0-00ae5b51418a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1297 microversion: 2.1 time: 0.168876 Sep 11 08:50:00.776402 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 243/457] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:00 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1297 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:01.031455 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:01.043948 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:01.045965 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:01.052416 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-92be335f-d1b7-49a5-bd45-7002b5137b53 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1720 microversion: 2.20 time: 0.522749 Sep 11 08:50:01.052416 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 215/458] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:00 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1720 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:01.627476 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:01.630072 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:01.670509 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:01.671908 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:01.673086 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:01.676470 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:01.677644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:01.678751 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:01.743172 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:01.743669 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:01.744166 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:01.744633 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lazy-loading 'fault' on Instance uuid 61189881-e8ae-431a-aecb-4e45d144369c {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:50:01.824115 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5c0e831a-b9d8-4f20-b32e-38a1d34e8f54 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:01.825298 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5c0e831a-b9d8-4f20-b32e-38a1d34e8f54 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:01.868757 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=8 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:01.882865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c0e831a-b9d8-4f20-b32e-38a1d34e8f54 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:01.882865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c0e831a-b9d8-4f20-b32e-38a1d34e8f54 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:01.883272 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2338046a594f9eb4f2fef030f1b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baaaaf5f58244280b0e265aa43bc571b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:01.884671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c0e831a-b9d8-4f20-b32e-38a1d34e8f54 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:01.885498 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c0e831a-b9d8-4f20-b32e-38a1d34e8f54 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:01.885976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c0e831a-b9d8-4f20-b32e-38a1d34e8f54 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:01.891408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c0e831a-b9d8-4f20-b32e-38a1d34e8f54 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:01.896459 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-215ac6ee-a3cd-48e2-b488-ba66014382a9 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 200 len: 1304 microversion: 2.1 time: 0.281044 Sep 11 08:50:01.901553 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 244/459] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:01 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 1304 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:50:02.034465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5c0e831a-b9d8-4f20-b32e-38a1d34e8f54 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:02.043573 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5c0e831a-b9d8-4f20-b32e-38a1d34e8f54 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1315 microversion: 2.1 time: 0.229989 Sep 11 08:50:02.045563 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 216/460] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:01 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:02.074944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:02.075641 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:02.084915 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:02.085420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:02.085834 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:02.086585 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:02.087032 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:02.087633 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:02.458275 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:02.468444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:02.470650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:02.472155 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-505d425d-3749-4af3-8558-495e2368da11 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1723 microversion: 2.20 time: 0.401240 Sep 11 08:50:02.486677 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 245/461] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:02 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:02.499014 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-463c30df-5c52-4f71-9a25-37a93c5335fb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7aa2fe37-fa13-4364-82f5-64991df83607"}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:02.501910 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-463c30df-5c52-4f71-9a25-37a93c5335fb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:02.526773 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-463c30df-5c52-4f71-9a25-37a93c5335fb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:02.526773 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-463c30df-5c52-4f71-9a25-37a93c5335fb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:02.526773 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-463c30df-5c52-4f71-9a25-37a93c5335fb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:02.526773 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-463c30df-5c52-4f71-9a25-37a93c5335fb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:02.527300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-463c30df-5c52-4f71-9a25-37a93c5335fb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:02.527300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-463c30df-5c52-4f71-9a25-37a93c5335fb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:02.927623 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:02.928955 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] [instance: 61189881-e8ae-431a-aecb-4e45d144369c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:02.938769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:02.943424 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:02.944178 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:02.944614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:02.945501 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:02.946282 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:02.947240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:02.983180 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] HTTP exception thrown: Instance 61189881-e8ae-431a-aecb-4e45d144369c could not be found. Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Request method failure captured: Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c HTTP/1.1 Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaD9eHTgkncnJszaQdDEZvzefNmtAL4RrP3jANUqT_KYoLH4hGOIqZoulnz8M-bH1y9EBYITPv-DIDvMrtZfHxobFpSVsfhW2pfbY2ojDzWdBUQcP0G4w1t4ITuNYgM1I8v3tYmL-CalMN5R_lhWHeT6f0Dg8IW31JlyBQB8Tq-_eNI Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: baaaaf5f58244280b0e265aa43bc571b Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-VolumesNegativeTest-221201338 Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:50:02.993740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/baaaaf5f58244280b0e265aa43bc571b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/baaaaf5f58244280b0e265aa43bc571b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/baaaaf5f58244280b0e265aa43bc571b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_baaaaf5f58244280b0e265aa43bc571b", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-VolumesNegativeTest-221201338 Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: baaaaf5f58244280b0e265aa43bc571b Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-VolumesNegativeTest-221201338 Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-VolumesNegativeTest-221201338-project Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: 7c2338046a594f9eb4f2fef030f1b82b Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-VolumesNegativeTest-221201338-project Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance 61189881-e8ae-431a-aecb-4e45d144369c could not be found. Sep 11 08:50:02.995247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': '61189881-e8ae-431a-aecb-4e45d144369c'} Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61189881-e8ae-431a-aecb-4e45d144369c could not be found. Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:50:02.996016 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61189881-e8ae-431a-aecb-4e45d144369c could not be found. Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61189881-e8ae-431a-aecb-4e45d144369c could not be found. Sep 11 08:50:02.997213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:50:03.000952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] Returning 404 to user: Instance 61189881-e8ae-431a-aecb-4e45d144369c could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:50:03.003153 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-fe82f6df-5498-42c4-8acd-53d7cc73f938 tempest-VolumesNegativeTest-221201338 tempest-VolumesNegativeTest-221201338-project] 10.222.0.44 "GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c" status: 404 len: 111 microversion: 2.1 time: 0.083228 Sep 11 08:50:03.011037 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 246/462] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:02 2022] GET /compute/v2.1/servers/61189881-e8ae-431a-aecb-4e45d144369c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:50:03.087334 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8bfefdb6-4bdc-4321-9849-c21c2124ab25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:03.088337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8bfefdb6-4bdc-4321-9849-c21c2124ab25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:03.111348 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bfefdb6-4bdc-4321-9849-c21c2124ab25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:03.113399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bfefdb6-4bdc-4321-9849-c21c2124ab25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:03.114631 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bfefdb6-4bdc-4321-9849-c21c2124ab25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:03.115516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bfefdb6-4bdc-4321-9849-c21c2124ab25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:03.116680 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bfefdb6-4bdc-4321-9849-c21c2124ab25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:03.117398 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bfefdb6-4bdc-4321-9849-c21c2124ab25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:03.278179 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8bfefdb6-4bdc-4321-9849-c21c2124ab25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:03.290975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8bfefdb6-4bdc-4321-9849-c21c2124ab25 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1303 microversion: 2.1 time: 0.208141 Sep 11 08:50:03.316058 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 247/463] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:03 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:03.326093 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b9d2d25d-2a1c-43ff-8963-a259d58382f9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1885598602"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:03.327165 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b9d2d25d-2a1c-43ff-8963-a259d58382f9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:03.343101 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9d2d25d-2a1c-43ff-8963-a259d58382f9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:03.344001 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9d2d25d-2a1c-43ff-8963-a259d58382f9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:03.346680 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9d2d25d-2a1c-43ff-8963-a259d58382f9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:03.347751 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9d2d25d-2a1c-43ff-8963-a259d58382f9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:03.350325 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9d2d25d-2a1c-43ff-8963-a259d58382f9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:03.351042 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9d2d25d-2a1c-43ff-8963-a259d58382f9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:03.601221 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.network.security_group_api [None req-b9d2d25d-2a1c-43ff-8963-a259d58382f9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Adding security group ea3ba507-74a2-424e-a74e-3ed015c08b60 to port fa04f10d-c16c-4338-8893-20b0b4de7866 Sep 11 08:50:04.293016 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:04.460501 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-463c30df-5c52-4f71-9a25-37a93c5335fb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "POST /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.965914 Sep 11 08:50:04.461134 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 217/464] 10.222.0.44 () {62 vars in 1364 bytes} [Sun Sep 11 08:50:02 2022] POST /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments => generated 188 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:50:04.466519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-db9b7e7f-8075-42d1-94b8-7967db58f651 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:04.467377 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-db9b7e7f-8075-42d1-94b8-7967db58f651 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:04.482429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-db9b7e7f-8075-42d1-94b8-7967db58f651 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:04.487107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-db9b7e7f-8075-42d1-94b8-7967db58f651 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:04.494396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-db9b7e7f-8075-42d1-94b8-7967db58f651 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:04.494396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-db9b7e7f-8075-42d1-94b8-7967db58f651 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:04.494396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-db9b7e7f-8075-42d1-94b8-7967db58f651 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:04.494396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-db9b7e7f-8075-42d1-94b8-7967db58f651 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:04.739477 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-db9b7e7f-8075-42d1-94b8-7967db58f651 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:04.757342 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-db9b7e7f-8075-42d1-94b8-7967db58f651 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.294765 Sep 11 08:50:04.757970 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 218/465] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:04 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:04.772299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-fb4daa3b-156c-454b-a6a6-038b01b1f1e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:04.772537 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b9d2d25d-2a1c-43ff-8963-a259d58382f9 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "POST /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/action" status: 202 len: 0 microversion: 2.1 time: 1.454840 Sep 11 08:50:04.774109 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-fb4daa3b-156c-454b-a6a6-038b01b1f1e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:04.774723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 248/466] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:50:03 2022] POST /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/action => generated 0 bytes in 1458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:50:04.788070 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f90b8072-550f-4435-abef-a4478f226f1c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:04.788874 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f90b8072-550f-4435-abef-a4478f226f1c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:04.797710 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb4daa3b-156c-454b-a6a6-038b01b1f1e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:04.797710 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb4daa3b-156c-454b-a6a6-038b01b1f1e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:04.797710 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb4daa3b-156c-454b-a6a6-038b01b1f1e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:04.797710 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb4daa3b-156c-454b-a6a6-038b01b1f1e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:04.798173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb4daa3b-156c-454b-a6a6-038b01b1f1e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:04.798173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fb4daa3b-156c-454b-a6a6-038b01b1f1e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:04.810562 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f90b8072-550f-4435-abef-a4478f226f1c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:04.814493 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f90b8072-550f-4435-abef-a4478f226f1c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:04.821248 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f90b8072-550f-4435-abef-a4478f226f1c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:04.821248 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f90b8072-550f-4435-abef-a4478f226f1c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:04.821248 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f90b8072-550f-4435-abef-a4478f226f1c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:04.821248 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f90b8072-550f-4435-abef-a4478f226f1c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:04.873464 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-fb4daa3b-156c-454b-a6a6-038b01b1f1e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127647) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 08:50:05.242808 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f90b8072-550f-4435-abef-a4478f226f1c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:05.251311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f90b8072-550f-4435-abef-a4478f226f1c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1760 microversion: 2.1 time: 0.467138 Sep 11 08:50:05.255836 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 249/467] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:04 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1760 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:05.274058 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-edc66439-dde9-477f-8250-0ddff5b21e6e req-08b2e40d-182b-492d-8609-4ed8f0b0fb76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2520cc9-8413-40ef-9b12-b5914bff16e2", "tag": "fa04f10d-c16c-4338-8893-20b0b4de7866"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:05.274959 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-fb4daa3b-156c-454b-a6a6-038b01b1f1e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "POST /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/action" status: 202 len: 0 microversion: 2.20 time: 0.509336 Sep 11 08:50:05.276035 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 219/468] 10.222.0.44 () {62 vars in 1319 bytes} [Sun Sep 11 08:50:04 2022] POST /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:50:05.288665 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:05.307282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:05.316597 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:05.322906 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-edc66439-dde9-477f-8250-0ddff5b21e6e req-08b2e40d-182b-492d-8609-4ed8f0b0fb76 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:05.325916 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-edc66439-dde9-477f-8250-0ddff5b21e6e req-08b2e40d-182b-492d-8609-4ed8f0b0fb76 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:05.326520 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-edc66439-dde9-477f-8250-0ddff5b21e6e req-08b2e40d-182b-492d-8609-4ed8f0b0fb76 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:05.327895 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:05.328353 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:05.328788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:05.332237 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:05.342423 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:05.342423 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:05.362116 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-edc66439-dde9-477f-8250-0ddff5b21e6e req-08b2e40d-182b-492d-8609-4ed8f0b0fb76 service nova] Creating event network-changed:fa04f10d-c16c-4338-8893-20b0b4de7866 for instance a2520cc9-8413-40ef-9b12-b5914bff16e2 on hv-cinder-85694 Sep 11 08:50:05.376214 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-edc66439-dde9-477f-8250-0ddff5b21e6e req-08b2e40d-182b-492d-8609-4ed8f0b0fb76 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118576 Sep 11 08:50:05.379449 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 250/469] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:50:05.547784 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:05.557531 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:05.560714 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:05.562948 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ca5886b6-270a-4839-b815-6460f7823776 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1749 microversion: 2.20 time: 0.279316 Sep 11 08:50:05.564189 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 220/470] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:05 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1749 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:05.808337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-979c3223-2ae4-432c-a267-3b34939e57c0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:05.810420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-979c3223-2ae4-432c-a267-3b34939e57c0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:05.823572 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-979c3223-2ae4-432c-a267-3b34939e57c0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:05.826004 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-979c3223-2ae4-432c-a267-3b34939e57c0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:05.826756 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-979c3223-2ae4-432c-a267-3b34939e57c0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:05.827446 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-979c3223-2ae4-432c-a267-3b34939e57c0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:05.829962 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-979c3223-2ae4-432c-a267-3b34939e57c0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:05.830815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-979c3223-2ae4-432c-a267-3b34939e57c0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:06.180972 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-979c3223-2ae4-432c-a267-3b34939e57c0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:06.195662 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-979c3223-2ae4-432c-a267-3b34939e57c0 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.387030 Sep 11 08:50:06.196443 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 251/471] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:05 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:06.593679 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:06.594531 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:06.602008 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:06.602558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:06.602989 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:06.603686 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:06.604210 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:06.604639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:06.824175 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:06.838458 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:06.841010 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:06.843052 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f0a2884b-1b33-466d-9c44-9ea72a885436 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1749 microversion: 2.20 time: 0.253535 Sep 11 08:50:06.844351 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 221/472] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:06 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1749 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:50:07.229695 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c88a3501-bc02-469e-aae0-b3f06f376f9e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:07.230641 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c88a3501-bc02-469e-aae0-b3f06f376f9e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:07.244807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c88a3501-bc02-469e-aae0-b3f06f376f9e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:07.245917 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c88a3501-bc02-469e-aae0-b3f06f376f9e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:07.246742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c88a3501-bc02-469e-aae0-b3f06f376f9e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:07.248359 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c88a3501-bc02-469e-aae0-b3f06f376f9e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:07.248999 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c88a3501-bc02-469e-aae0-b3f06f376f9e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:07.249534 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c88a3501-bc02-469e-aae0-b3f06f376f9e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:07.398320 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-1242b88a-3e02-4b2d-be76-5a10bda55ca6 req-2e7919ed-a577-4848-a5af-c3389024191c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecad74b6-c736-4f92-9339-9fe3221c0700", "tag": "fb0a2c0a-f47e-49a3-a803-c69e51e3ed11"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:07.412642 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-1242b88a-3e02-4b2d-be76-5a10bda55ca6 req-2e7919ed-a577-4848-a5af-c3389024191c service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:07.413172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-1242b88a-3e02-4b2d-be76-5a10bda55ca6 req-2e7919ed-a577-4848-a5af-c3389024191c service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:07.416428 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-1242b88a-3e02-4b2d-be76-5a10bda55ca6 req-2e7919ed-a577-4848-a5af-c3389024191c service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:07.447211 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-1242b88a-3e02-4b2d-be76-5a10bda55ca6 req-2e7919ed-a577-4848-a5af-c3389024191c service nova] Creating event network-changed:fb0a2c0a-f47e-49a3-a803-c69e51e3ed11 for instance ecad74b6-c736-4f92-9339-9fe3221c0700 on hv-cinder-85694 Sep 11 08:50:07.452634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-1242b88a-3e02-4b2d-be76-5a10bda55ca6 req-2e7919ed-a577-4848-a5af-c3389024191c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060614 Sep 11 08:50:07.453699 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 222/473] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:50:07.551597 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c88a3501-bc02-469e-aae0-b3f06f376f9e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:07.565809 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c88a3501-bc02-469e-aae0-b3f06f376f9e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.341552 Sep 11 08:50:07.567024 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 252/474] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:07 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:07.876941 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:07.878491 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:07.896077 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:07.897091 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:07.897730 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:07.898894 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:07.899663 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:07.900355 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:08.327288 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:08.338618 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:08.340623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:08.342734 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e713be2d-8909-49f7-9ba4-c2fdd7a90db9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1749 microversion: 2.20 time: 0.472739 Sep 11 08:50:08.343614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 223/475] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:07 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1749 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:08.595734 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ba98ac9f-c3c0-48c8-895d-3dcbe5812e1b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:08.597018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ba98ac9f-c3c0-48c8-895d-3dcbe5812e1b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:08.605269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba98ac9f-c3c0-48c8-895d-3dcbe5812e1b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:08.606023 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba98ac9f-c3c0-48c8-895d-3dcbe5812e1b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:08.606684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba98ac9f-c3c0-48c8-895d-3dcbe5812e1b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:08.608309 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba98ac9f-c3c0-48c8-895d-3dcbe5812e1b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:08.608967 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba98ac9f-c3c0-48c8-895d-3dcbe5812e1b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:08.609686 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba98ac9f-c3c0-48c8-895d-3dcbe5812e1b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:08.881781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ba98ac9f-c3c0-48c8-895d-3dcbe5812e1b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:08.895465 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ba98ac9f-c3c0-48c8-895d-3dcbe5812e1b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.299043 Sep 11 08:50:08.895465 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 253/476] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:08 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:09.378379 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:09.380687 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:09.392908 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:09.393577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:09.394139 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:09.395685 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:09.400419 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:09.400419 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:09.616949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:09.626038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:09.627689 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:09.628889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a9bc9356-f74b-4699-8c19-339497fb7a86 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1751 microversion: 2.20 time: 0.260956 Sep 11 08:50:09.629469 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 224/477] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:09 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1751 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:09.930804 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a9658250-37f2-4309-b536-07011275aa00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:09.931510 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a9658250-37f2-4309-b536-07011275aa00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:09.938250 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9658250-37f2-4309-b536-07011275aa00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:09.938748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9658250-37f2-4309-b536-07011275aa00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:09.939196 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9658250-37f2-4309-b536-07011275aa00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:09.940517 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9658250-37f2-4309-b536-07011275aa00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:09.940986 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9658250-37f2-4309-b536-07011275aa00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:09.941416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a9658250-37f2-4309-b536-07011275aa00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:10.434403 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a9658250-37f2-4309-b536-07011275aa00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:10.446950 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a9658250-37f2-4309-b536-07011275aa00 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.519868 Sep 11 08:50:10.450224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 254/478] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:09 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:10.656326 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:10.656885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:10.666855 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:10.667510 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:10.667970 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:10.668981 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:10.669571 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:10.670114 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:10.859160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:10.874803 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:10.877714 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:10.880025 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-945fa66a-6f08-4e7f-bc2c-fe060be3988a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1751 microversion: 2.20 time: 0.228100 Sep 11 08:50:10.881405 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 225/479] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:10 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:11.499660 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0be3fac6-8ea3-4c9a-96be-e6c2e3d1ad90 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:11.504037 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0be3fac6-8ea3-4c9a-96be-e6c2e3d1ad90 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:11.523898 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0be3fac6-8ea3-4c9a-96be-e6c2e3d1ad90 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:11.524617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0be3fac6-8ea3-4c9a-96be-e6c2e3d1ad90 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:11.525267 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0be3fac6-8ea3-4c9a-96be-e6c2e3d1ad90 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:11.527639 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0be3fac6-8ea3-4c9a-96be-e6c2e3d1ad90 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:11.528337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0be3fac6-8ea3-4c9a-96be-e6c2e3d1ad90 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:11.529051 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0be3fac6-8ea3-4c9a-96be-e6c2e3d1ad90 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:11.724075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0be3fac6-8ea3-4c9a-96be-e6c2e3d1ad90 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:11.733681 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0be3fac6-8ea3-4c9a-96be-e6c2e3d1ad90 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.242378 Sep 11 08:50:11.746649 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 255/480] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:11 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:11.912619 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:11.913282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:11.920063 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:11.920560 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:11.920994 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:11.921722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:11.922308 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:11.922744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:12.124242 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:12.135356 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:12.138381 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:12.139937 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-562e1a6a-f374-40dd-9985-738a202b62f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.231801 Sep 11 08:50:12.140714 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 226/481] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:11 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:50:12.771451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-18c01559-e01a-4a5f-a6dc-38549fa496f1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:12.772507 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-18c01559-e01a-4a5f-a6dc-38549fa496f1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:12.785133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-18c01559-e01a-4a5f-a6dc-38549fa496f1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:12.785999 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-18c01559-e01a-4a5f-a6dc-38549fa496f1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:12.786870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-18c01559-e01a-4a5f-a6dc-38549fa496f1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:12.788186 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-18c01559-e01a-4a5f-a6dc-38549fa496f1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:12.789277 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-18c01559-e01a-4a5f-a6dc-38549fa496f1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:12.790389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-18c01559-e01a-4a5f-a6dc-38549fa496f1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:13.156127 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-18c01559-e01a-4a5f-a6dc-38549fa496f1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:13.169922 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-18c01559-e01a-4a5f-a6dc-38549fa496f1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.405968 Sep 11 08:50:13.178974 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:13.182731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:13.187373 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 256/482] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:12 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:13.211843 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:13.213865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:13.215709 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:13.216870 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:13.217515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:13.220014 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:13.481424 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:13.497238 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:13.497238 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:13.497948 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5f54f667-6385-4b2f-8a29-ff82a2848f5d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.329115 Sep 11 08:50:13.508043 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 227/483] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:13 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:14.215456 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d3156785-08d9-484b-bd9a-30e0536df0cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:14.216119 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d3156785-08d9-484b-bd9a-30e0536df0cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:14.230023 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3156785-08d9-484b-bd9a-30e0536df0cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:14.230664 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3156785-08d9-484b-bd9a-30e0536df0cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:14.232119 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3156785-08d9-484b-bd9a-30e0536df0cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:14.232850 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3156785-08d9-484b-bd9a-30e0536df0cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:14.234705 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3156785-08d9-484b-bd9a-30e0536df0cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:14.235149 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d3156785-08d9-484b-bd9a-30e0536df0cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:14.478533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d3156785-08d9-484b-bd9a-30e0536df0cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:14.478533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d3156785-08d9-484b-bd9a-30e0536df0cb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.241594 Sep 11 08:50:14.478533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 257/484] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:14 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:14.524394 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:14.525598 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:14.535248 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:14.535938 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:14.536542 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:14.537420 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:14.537993 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:14.538546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:14.902675 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:14.953070 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:14.953070 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:14.953070 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4ae9a40d-940e-4998-be07-c1109c94b709 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.412427 Sep 11 08:50:14.953493 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 228/485] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:14 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:50:15.475851 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-992bdb48-05ce-4331-b335-feec1159d783 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:15.476482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-992bdb48-05ce-4331-b335-feec1159d783 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:15.496747 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-992bdb48-05ce-4331-b335-feec1159d783 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:15.499984 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-992bdb48-05ce-4331-b335-feec1159d783 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:15.503545 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-992bdb48-05ce-4331-b335-feec1159d783 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:15.514466 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-992bdb48-05ce-4331-b335-feec1159d783 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:15.515521 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-992bdb48-05ce-4331-b335-feec1159d783 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:15.516146 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-992bdb48-05ce-4331-b335-feec1159d783 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:15.847913 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-992bdb48-05ce-4331-b335-feec1159d783 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:15.866664 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-992bdb48-05ce-4331-b335-feec1159d783 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.395683 Sep 11 08:50:15.868725 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 258/486] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:15 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:15.979465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:15.980119 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:15.990813 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:16.005747 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:16.005945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:16.014549 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:16.015598 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:16.016130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:16.016928 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:16.521112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:16.557698 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-f08d4a9f-3e4a-4da7-8895-046fb6ef4ecf req-0efc37a6-645f-49db-87fd-8b750d62dbbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecad74b6-c736-4f92-9339-9fe3221c0700", "name": "network-vif-plugged", "status": "completed", "tag": "fb0a2c0a-f47e-49a3-a803-c69e51e3ed11"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:16.558561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:16.570095 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:16.570095 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e334a956-600c-4f1a-9859-dbbdc7311da5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.604257 Sep 11 08:50:16.570095 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 229/487] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:15 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:16.582244 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 08:50:16.582828 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Sun Sep 11 08:50:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Sep 11 08:50:16.594433 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-f08d4a9f-3e4a-4da7-8895-046fb6ef4ecf req-0efc37a6-645f-49db-87fd-8b750d62dbbe service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:16.597221 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-f08d4a9f-3e4a-4da7-8895-046fb6ef4ecf req-0efc37a6-645f-49db-87fd-8b750d62dbbe service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:16.602788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-f08d4a9f-3e4a-4da7-8895-046fb6ef4ecf req-0efc37a6-645f-49db-87fd-8b750d62dbbe service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:16.629453 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-f08d4a9f-3e4a-4da7-8895-046fb6ef4ecf req-0efc37a6-645f-49db-87fd-8b750d62dbbe service nova] Creating event network-vif-plugged:fb0a2c0a-f47e-49a3-a803-c69e51e3ed11 for instance ecad74b6-c736-4f92-9339-9fe3221c0700 on hv-cinder-85694 Sep 11 08:50:16.636156 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-f08d4a9f-3e4a-4da7-8895-046fb6ef4ecf req-0efc37a6-645f-49db-87fd-8b750d62dbbe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082018 Sep 11 08:50:16.637167 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 259/488] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:50:16.898470 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5d21f786-69b7-4e4e-8668-8a2f9d9b85f8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:16.899861 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5d21f786-69b7-4e4e-8668-8a2f9d9b85f8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:16.915623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d21f786-69b7-4e4e-8668-8a2f9d9b85f8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:16.917931 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d21f786-69b7-4e4e-8668-8a2f9d9b85f8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:16.919077 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d21f786-69b7-4e4e-8668-8a2f9d9b85f8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:16.932321 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d21f786-69b7-4e4e-8668-8a2f9d9b85f8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:16.932321 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d21f786-69b7-4e4e-8668-8a2f9d9b85f8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:16.932321 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5d21f786-69b7-4e4e-8668-8a2f9d9b85f8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:17.208095 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5d21f786-69b7-4e4e-8668-8a2f9d9b85f8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:17.233506 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5d21f786-69b7-4e4e-8668-8a2f9d9b85f8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.338794 Sep 11 08:50:17.233506 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 230/489] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:16 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:17.619839 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:17.621805 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:17.629634 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:17.630614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:17.631067 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:17.632106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:17.632333 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:17.633166 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:17.917546 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:17.937509 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:17.937509 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:17.937509 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b56b7b5d-62ae-4b7a-a716-a239142e36c3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.334983 Sep 11 08:50:17.937914 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 260/490] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:17 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:18.288173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b08498c1-be5c-4340-ad84-05026b77da99 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:18.295691 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b08498c1-be5c-4340-ad84-05026b77da99 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:18.336423 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b08498c1-be5c-4340-ad84-05026b77da99 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:18.337690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b08498c1-be5c-4340-ad84-05026b77da99 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:18.339799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b08498c1-be5c-4340-ad84-05026b77da99 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:18.345342 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b08498c1-be5c-4340-ad84-05026b77da99 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:18.348334 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b08498c1-be5c-4340-ad84-05026b77da99 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:18.349892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b08498c1-be5c-4340-ad84-05026b77da99 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:18.712932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b08498c1-be5c-4340-ad84-05026b77da99 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:18.743916 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b08498c1-be5c-4340-ad84-05026b77da99 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.487920 Sep 11 08:50:18.749406 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 231/491] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:18 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:18.980561 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:18.981728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:18.994763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:18.995593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:18.996040 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:18.996789 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:19.003038 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:19.003781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:19.279066 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:19.282473 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:19.292109 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:19.294183 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:19.295784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3cbe9e6e-0b51-4be1-aa61-61bb51c8aacf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.319971 Sep 11 08:50:19.296917 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 261/492] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:18 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:50:19.806925 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4bf9b276-f809-4ad9-a99e-ed71e30bcda4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:19.810373 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4bf9b276-f809-4ad9-a99e-ed71e30bcda4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:19.835073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4bf9b276-f809-4ad9-a99e-ed71e30bcda4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:19.840559 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4bf9b276-f809-4ad9-a99e-ed71e30bcda4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:19.841570 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4bf9b276-f809-4ad9-a99e-ed71e30bcda4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:19.844059 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4bf9b276-f809-4ad9-a99e-ed71e30bcda4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:19.846539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4bf9b276-f809-4ad9-a99e-ed71e30bcda4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:19.847788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4bf9b276-f809-4ad9-a99e-ed71e30bcda4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:20.343962 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4bf9b276-f809-4ad9-a99e-ed71e30bcda4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:20.351611 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:20.362317 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:20.377776 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:20.378967 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:20.379627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4bf9b276-f809-4ad9-a99e-ed71e30bcda4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.590924 Sep 11 08:50:20.380394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:20.382061 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:20.383209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:20.384348 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:20.390630 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 232/493] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:19 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:20.706802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:20.719525 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:20.721491 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:20.723297 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f5733742-a659-4513-86ff-1ab6e17a88b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.381555 Sep 11 08:50:20.724774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 262/494] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:20 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:21.404273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-18e83f5f-af28-4ab7-9fe0-9f4a7c80d3c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:21.405799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-18e83f5f-af28-4ab7-9fe0-9f4a7c80d3c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:21.419334 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18e83f5f-af28-4ab7-9fe0-9f4a7c80d3c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:21.420169 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18e83f5f-af28-4ab7-9fe0-9f4a7c80d3c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:21.422239 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18e83f5f-af28-4ab7-9fe0-9f4a7c80d3c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:21.423204 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18e83f5f-af28-4ab7-9fe0-9f4a7c80d3c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:21.430080 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18e83f5f-af28-4ab7-9fe0-9f4a7c80d3c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:21.430798 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-18e83f5f-af28-4ab7-9fe0-9f4a7c80d3c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:21.460833 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:21.729274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-18e83f5f-af28-4ab7-9fe0-9f4a7c80d3c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:21.758369 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:21.759408 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:21.770118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:21.771119 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:21.774118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:21.774289 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-18e83f5f-af28-4ab7-9fe0-9f4a7c80d3c9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.368572 Sep 11 08:50:21.777927 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 233/495] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:21 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:21.796424 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:21.797099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:21.798094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:22.019626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:22.030193 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:22.031658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:22.033759 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5a5dff59-11a3-4c18-8d44-aa03b5ae4676 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.284464 Sep 11 08:50:22.034540 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 263/496] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:21 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:50:22.804155 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-679ffb8f-9ea9-4a31-93d5-948544aa6747 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:22.804155 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-679ffb8f-9ea9-4a31-93d5-948544aa6747 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:22.829078 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-679ffb8f-9ea9-4a31-93d5-948544aa6747 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:22.831079 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-679ffb8f-9ea9-4a31-93d5-948544aa6747 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:22.831609 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-679ffb8f-9ea9-4a31-93d5-948544aa6747 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:22.833621 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-679ffb8f-9ea9-4a31-93d5-948544aa6747 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:22.834906 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-679ffb8f-9ea9-4a31-93d5-948544aa6747 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:22.835351 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-679ffb8f-9ea9-4a31-93d5-948544aa6747 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:23.061174 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:23.061960 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:23.085120 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:23.088929 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:23.089633 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:23.093941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:23.094732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:23.098095 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:23.238243 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-679ffb8f-9ea9-4a31-93d5-948544aa6747 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:23.249676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-679ffb8f-9ea9-4a31-93d5-948544aa6747 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.452474 Sep 11 08:50:23.250834 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 234/497] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:22 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:23.468948 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:23.480404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:23.498327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:23.498327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6deb1b22-e7d3-4108-9bde-e38b39b2d029 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.426379 Sep 11 08:50:23.498327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 264/498] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:23 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:50:24.278105 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bb15a52a-f92f-4a6c-b69b-fe59ccef59af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:24.278910 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bb15a52a-f92f-4a6c-b69b-fe59ccef59af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:24.290972 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb15a52a-f92f-4a6c-b69b-fe59ccef59af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:24.299637 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb15a52a-f92f-4a6c-b69b-fe59ccef59af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:24.300283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb15a52a-f92f-4a6c-b69b-fe59ccef59af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:24.301112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb15a52a-f92f-4a6c-b69b-fe59ccef59af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:24.302506 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb15a52a-f92f-4a6c-b69b-fe59ccef59af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:24.305814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb15a52a-f92f-4a6c-b69b-fe59ccef59af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:24.515498 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:24.520645 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:24.528791 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:24.549694 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:24.557853 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:24.560001 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:24.563116 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:24.570013 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:25.065103 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bb15a52a-f92f-4a6c-b69b-fe59ccef59af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:25.096235 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bb15a52a-f92f-4a6c-b69b-fe59ccef59af tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.821449 Sep 11 08:50:25.099089 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 235/499] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:24 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:50:25.198870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:25.239746 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:25.252913 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:25.258089 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b759786d-ce3c-443a-8fdd-96f1c5db6c2e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.745351 Sep 11 08:50:25.261281 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 265/500] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:24 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:26.050789 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bcd1b967-a1b1-433c-8f38-f63f45933ed6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:26.053155 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bcd1b967-a1b1-433c-8f38-f63f45933ed6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:26.060129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcd1b967-a1b1-433c-8f38-f63f45933ed6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:26.061322 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcd1b967-a1b1-433c-8f38-f63f45933ed6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:26.061970 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcd1b967-a1b1-433c-8f38-f63f45933ed6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:26.062884 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcd1b967-a1b1-433c-8f38-f63f45933ed6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:26.063567 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcd1b967-a1b1-433c-8f38-f63f45933ed6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:26.064027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bcd1b967-a1b1-433c-8f38-f63f45933ed6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:26.145572 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a338966e-7a1d-4adc-86da-4926c4249397 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:26.146546 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a338966e-7a1d-4adc-86da-4926c4249397 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:26.153295 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a338966e-7a1d-4adc-86da-4926c4249397 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:26.153796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a338966e-7a1d-4adc-86da-4926c4249397 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:26.154260 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a338966e-7a1d-4adc-86da-4926c4249397 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:26.154966 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a338966e-7a1d-4adc-86da-4926c4249397 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:26.155416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a338966e-7a1d-4adc-86da-4926c4249397 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:26.155837 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a338966e-7a1d-4adc-86da-4926c4249397 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:26.309330 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a338966e-7a1d-4adc-86da-4926c4249397 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:26.317324 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a338966e-7a1d-4adc-86da-4926c4249397 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.180773 Sep 11 08:50:26.317892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 266/501] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:26 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:26.329199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:26.330389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:26.336603 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:26.337096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:26.343528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:26.344579 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:26.345885 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:26.346382 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:26.496765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:26.506121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:26.507565 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:26.508721 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-41519915-e32f-4caf-a9ca-e53a9c905042 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.189709 Sep 11 08:50:26.509306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 267/502] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:26 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:27.144690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bcd1b967-a1b1-433c-8f38-f63f45933ed6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "POST /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/action" status: 202 len: 0 microversion: 2.1 time: 1.097779 Sep 11 08:50:27.145789 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 236/503] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:50:26 2022] POST /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/action => generated 0 bytes in 1100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:50:27.154029 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d0fd22a4-b1e8-4da7-b666-4642d9e9c639 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:27.154862 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d0fd22a4-b1e8-4da7-b666-4642d9e9c639 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:27.161924 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0fd22a4-b1e8-4da7-b666-4642d9e9c639 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:27.162565 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0fd22a4-b1e8-4da7-b666-4642d9e9c639 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:27.163083 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0fd22a4-b1e8-4da7-b666-4642d9e9c639 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:27.163709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0fd22a4-b1e8-4da7-b666-4642d9e9c639 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:27.164161 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0fd22a4-b1e8-4da7-b666-4642d9e9c639 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:27.164797 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0fd22a4-b1e8-4da7-b666-4642d9e9c639 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:27.342532 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-422be2b0-b6d6-44d2-b41f-606021c5efac tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:27.343637 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-422be2b0-b6d6-44d2-b41f-606021c5efac tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:27.351315 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-422be2b0-b6d6-44d2-b41f-606021c5efac tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:27.352399 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-422be2b0-b6d6-44d2-b41f-606021c5efac tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:27.353119 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-422be2b0-b6d6-44d2-b41f-606021c5efac tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:27.354196 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-422be2b0-b6d6-44d2-b41f-606021c5efac tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:27.354864 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-422be2b0-b6d6-44d2-b41f-606021c5efac tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:27.355518 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-422be2b0-b6d6-44d2-b41f-606021c5efac tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:27.489960 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d0fd22a4-b1e8-4da7-b666-4642d9e9c639 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:27.506274 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d0fd22a4-b1e8-4da7-b666-4642d9e9c639 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1752 microversion: 2.1 time: 0.355248 Sep 11 08:50:27.525175 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 268/504] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:27 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1752 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:27.568786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:27.570873 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:27.580340 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:27.581515 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:27.582183 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:27.587949 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:27.587949 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:27.587949 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:27.623934 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-422be2b0-b6d6-44d2-b41f-606021c5efac tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:27.634620 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-422be2b0-b6d6-44d2-b41f-606021c5efac tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1371 microversion: 2.1 time: 0.296285 Sep 11 08:50:27.636035 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 237/505] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:27 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:28.118616 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:28.131155 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:28.132688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:28.133958 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-285f1354-6c4b-4708-af87-35e0b2dd2d5b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.575202 Sep 11 08:50:28.134673 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 269/506] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:27 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:28.535511 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-77a33e5e-983f-42f8-b782-4772f726d2ad tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:28.536100 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-77a33e5e-983f-42f8-b782-4772f726d2ad tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:28.542825 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77a33e5e-983f-42f8-b782-4772f726d2ad tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:28.543744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77a33e5e-983f-42f8-b782-4772f726d2ad tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:28.544361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77a33e5e-983f-42f8-b782-4772f726d2ad tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:28.545247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77a33e5e-983f-42f8-b782-4772f726d2ad tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:28.545705 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77a33e5e-983f-42f8-b782-4772f726d2ad tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:28.546337 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77a33e5e-983f-42f8-b782-4772f726d2ad tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:28.661749 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a19e5c02-fd08-4005-81c6-a7ce545ea322 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:28.662492 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a19e5c02-fd08-4005-81c6-a7ce545ea322 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:28.690181 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a19e5c02-fd08-4005-81c6-a7ce545ea322 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:28.694022 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a19e5c02-fd08-4005-81c6-a7ce545ea322 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:28.694603 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a19e5c02-fd08-4005-81c6-a7ce545ea322 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:28.696357 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a19e5c02-fd08-4005-81c6-a7ce545ea322 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:28.696357 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a19e5c02-fd08-4005-81c6-a7ce545ea322 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:28.697924 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a19e5c02-fd08-4005-81c6-a7ce545ea322 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:29.003006 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-77a33e5e-983f-42f8-b782-4772f726d2ad tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:29.015538 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-77a33e5e-983f-42f8-b782-4772f726d2ad tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1752 microversion: 2.1 time: 0.484436 Sep 11 08:50:29.016873 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 238/507] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:28 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1752 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:29.089139 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a19e5c02-fd08-4005-81c6-a7ce545ea322 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:29.098746 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a19e5c02-fd08-4005-81c6-a7ce545ea322 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1565 microversion: 2.1 time: 0.441442 Sep 11 08:50:29.116024 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 270/508] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:28 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1565 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:50:29.123017 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bb612020-f076-4288-94cc-0f3e0c473ac6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:29.123516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bb612020-f076-4288-94cc-0f3e0c473ac6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:29.130569 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb612020-f076-4288-94cc-0f3e0c473ac6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:29.131320 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb612020-f076-4288-94cc-0f3e0c473ac6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:29.132457 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb612020-f076-4288-94cc-0f3e0c473ac6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:29.133356 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb612020-f076-4288-94cc-0f3e0c473ac6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:29.134074 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb612020-f076-4288-94cc-0f3e0c473ac6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:29.135244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bb612020-f076-4288-94cc-0f3e0c473ac6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:29.163810 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:29.164671 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:29.177646 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:29.183354 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:29.186746 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:29.187580 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:29.191120 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:29.191623 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:29.311871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bb612020-f076-4288-94cc-0f3e0c473ac6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.191913 Sep 11 08:50:29.312471 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 239/509] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 08:50:29 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:50:29.451653 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:29.462491 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:29.464489 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:29.465712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f779bc16-4b1e-4bf3-92ca-7ddd5c9ea6f9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.306470 Sep 11 08:50:29.466636 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 271/510] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:29 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:50:30.042576 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-69a3a79e-13c3-4a25-8f4e-4bf3ffd37bbd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:30.044067 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-69a3a79e-13c3-4a25-8f4e-4bf3ffd37bbd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:30.058038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-69a3a79e-13c3-4a25-8f4e-4bf3ffd37bbd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:30.062413 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-69a3a79e-13c3-4a25-8f4e-4bf3ffd37bbd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:30.063101 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-69a3a79e-13c3-4a25-8f4e-4bf3ffd37bbd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:30.064592 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-69a3a79e-13c3-4a25-8f4e-4bf3ffd37bbd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:30.065166 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-69a3a79e-13c3-4a25-8f4e-4bf3ffd37bbd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:30.065688 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-69a3a79e-13c3-4a25-8f4e-4bf3ffd37bbd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:30.408668 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-69a3a79e-13c3-4a25-8f4e-4bf3ffd37bbd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:30.421590 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-69a3a79e-13c3-4a25-8f4e-4bf3ffd37bbd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1752 microversion: 2.1 time: 0.384406 Sep 11 08:50:30.437966 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 240/511] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:30 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1752 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:30.504627 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:30.505247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:30.530622 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:30.531705 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:30.535235 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:30.536469 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:30.537101 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:30.538800 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:30.741217 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:30.754548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:30.756206 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:30.757398 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-14268882-ceef-4ba7-b6ab-2d81e1740cf0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.262577 Sep 11 08:50:30.776897 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 272/512] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:30 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:31.387031 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-97ad21aa-07b5-4066-8d0e-8f34c334b4a8 req-876453fa-929a-42cf-b66f-7c80a61ea0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecad74b6-c736-4f92-9339-9fe3221c0700", "tag": "fb0a2c0a-f47e-49a3-a803-c69e51e3ed11"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:31.398838 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-97ad21aa-07b5-4066-8d0e-8f34c334b4a8 req-876453fa-929a-42cf-b66f-7c80a61ea0c7 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:31.399357 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-97ad21aa-07b5-4066-8d0e-8f34c334b4a8 req-876453fa-929a-42cf-b66f-7c80a61ea0c7 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:31.400077 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-97ad21aa-07b5-4066-8d0e-8f34c334b4a8 req-876453fa-929a-42cf-b66f-7c80a61ea0c7 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:31.417743 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-97ad21aa-07b5-4066-8d0e-8f34c334b4a8 req-876453fa-929a-42cf-b66f-7c80a61ea0c7 service nova] Creating event network-changed:fb0a2c0a-f47e-49a3-a803-c69e51e3ed11 for instance ecad74b6-c736-4f92-9339-9fe3221c0700 on hv-cinder-85694 Sep 11 08:50:31.425348 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-97ad21aa-07b5-4066-8d0e-8f34c334b4a8 req-876453fa-929a-42cf-b66f-7c80a61ea0c7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041782 Sep 11 08:50:31.431081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 241/513] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:50:31.447216 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-190a7397-ece1-4d8c-84a9-8dffd69d3a4f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:31.447876 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-190a7397-ece1-4d8c-84a9-8dffd69d3a4f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:31.459547 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-190a7397-ece1-4d8c-84a9-8dffd69d3a4f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:31.460064 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-190a7397-ece1-4d8c-84a9-8dffd69d3a4f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:31.460505 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-190a7397-ece1-4d8c-84a9-8dffd69d3a4f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:31.461222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-190a7397-ece1-4d8c-84a9-8dffd69d3a4f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:31.461684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-190a7397-ece1-4d8c-84a9-8dffd69d3a4f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:31.462114 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-190a7397-ece1-4d8c-84a9-8dffd69d3a4f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:31.699686 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-190a7397-ece1-4d8c-84a9-8dffd69d3a4f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:31.710704 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-190a7397-ece1-4d8c-84a9-8dffd69d3a4f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.269023 Sep 11 08:50:31.714191 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 273/514] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:31 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:31.806251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:31.806899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:31.823333 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:31.823333 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:31.823333 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:31.823333 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:31.823744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:31.823744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:32.105486 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:32.127614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:32.130907 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:32.133547 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1579a107-3323-4767-b4aa-7b1d07069c8c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.331219 Sep 11 08:50:32.135016 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 242/515] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:31 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:32.736109 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4fc2d91d-ca38-4fc5-a71b-7c275b55eadb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:32.736717 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4fc2d91d-ca38-4fc5-a71b-7c275b55eadb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:32.744578 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fc2d91d-ca38-4fc5-a71b-7c275b55eadb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:32.745072 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fc2d91d-ca38-4fc5-a71b-7c275b55eadb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:32.745510 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fc2d91d-ca38-4fc5-a71b-7c275b55eadb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:32.746549 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fc2d91d-ca38-4fc5-a71b-7c275b55eadb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:32.747002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fc2d91d-ca38-4fc5-a71b-7c275b55eadb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:32.747426 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fc2d91d-ca38-4fc5-a71b-7c275b55eadb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:32.984867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4fc2d91d-ca38-4fc5-a71b-7c275b55eadb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:32.995226 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4fc2d91d-ca38-4fc5-a71b-7c275b55eadb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.264282 Sep 11 08:50:33.010689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 274/516] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:32 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:33.161717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:33.162355 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:33.168923 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:33.169416 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:33.169846 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:33.170610 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:33.171077 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:33.171496 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:33.331126 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:33.332930 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:33.334514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:33.335732 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8838e010-bd58-48f0-b410-59cf4c916888 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.178679 Sep 11 08:50:33.336304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 243/517] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:33 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:34.020764 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c37451d0-2cad-48fb-afc5-5a471958c37f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:34.021393 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c37451d0-2cad-48fb-afc5-5a471958c37f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:34.031937 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c37451d0-2cad-48fb-afc5-5a471958c37f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:34.032501 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c37451d0-2cad-48fb-afc5-5a471958c37f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:34.037699 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c37451d0-2cad-48fb-afc5-5a471958c37f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:34.037699 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c37451d0-2cad-48fb-afc5-5a471958c37f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:34.037699 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c37451d0-2cad-48fb-afc5-5a471958c37f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:34.037699 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c37451d0-2cad-48fb-afc5-5a471958c37f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:34.309048 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c37451d0-2cad-48fb-afc5-5a471958c37f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:34.321930 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c37451d0-2cad-48fb-afc5-5a471958c37f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.306044 Sep 11 08:50:34.322569 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 275/518] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:34 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:34.362889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:34.363518 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:34.377446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:34.378202 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:34.378813 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:34.379539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:34.380001 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:34.380570 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:34.581893 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:34.598515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:34.598515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:34.608408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-37fa03ae-1067-4297-8ad1-badeef2075cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.250779 Sep 11 08:50:34.609536 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 244/519] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:34 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:35.349120 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1add51d7-d933-48b4-96e1-9702ef0274d6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:35.350199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1add51d7-d933-48b4-96e1-9702ef0274d6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:35.357436 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1add51d7-d933-48b4-96e1-9702ef0274d6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:35.358921 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1add51d7-d933-48b4-96e1-9702ef0274d6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:35.359520 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1add51d7-d933-48b4-96e1-9702ef0274d6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:35.360586 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1add51d7-d933-48b4-96e1-9702ef0274d6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:35.360994 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1add51d7-d933-48b4-96e1-9702ef0274d6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:35.361660 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1add51d7-d933-48b4-96e1-9702ef0274d6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:35.625324 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1add51d7-d933-48b4-96e1-9702ef0274d6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:35.636299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:35.636913 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:35.639452 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1add51d7-d933-48b4-96e1-9702ef0274d6 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.295162 Sep 11 08:50:35.640075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 276/520] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:35 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:35.645278 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:35.645768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:35.646220 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:35.646923 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:35.647368 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:35.647784 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:35.796396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:35.810925 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:35.813020 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:35.815116 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f06a0344-e3ec-46c8-a77f-3b727e267782 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.182790 Sep 11 08:50:35.816482 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 245/521] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:35 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:50:36.665279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-54540c24-0bdd-4956-b2b7-9b9c94b1e3ff tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:36.666099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-54540c24-0bdd-4956-b2b7-9b9c94b1e3ff tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:36.674088 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=54 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:36.680784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54540c24-0bdd-4956-b2b7-9b9c94b1e3ff tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:36.681482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54540c24-0bdd-4956-b2b7-9b9c94b1e3ff tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:36.682025 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54540c24-0bdd-4956-b2b7-9b9c94b1e3ff tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:36.682901 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54540c24-0bdd-4956-b2b7-9b9c94b1e3ff tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:36.683457 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54540c24-0bdd-4956-b2b7-9b9c94b1e3ff tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:36.683976 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-54540c24-0bdd-4956-b2b7-9b9c94b1e3ff tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:36.841962 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:36.842620 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:36.854785 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:36.857012 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:36.857614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:36.858809 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:36.859426 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:36.860032 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:36.959620 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-54540c24-0bdd-4956-b2b7-9b9c94b1e3ff tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:36.975808 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-54540c24-0bdd-4956-b2b7-9b9c94b1e3ff tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.308192 Sep 11 08:50:36.990772 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 277/522] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:36 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:37.052989 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:37.061787 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:37.064191 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:37.065598 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-336d13f2-98db-4109-bbce-49f227ef13c2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.228400 Sep 11 08:50:37.066711 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 246/523] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:36 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:38.003760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-58e6e600-dada-432f-870b-baac9f59fe54 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:38.004628 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-58e6e600-dada-432f-870b-baac9f59fe54 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:38.011609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58e6e600-dada-432f-870b-baac9f59fe54 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:38.013006 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58e6e600-dada-432f-870b-baac9f59fe54 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:38.013662 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58e6e600-dada-432f-870b-baac9f59fe54 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:38.014578 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58e6e600-dada-432f-870b-baac9f59fe54 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:38.015206 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58e6e600-dada-432f-870b-baac9f59fe54 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:38.015803 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58e6e600-dada-432f-870b-baac9f59fe54 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:38.031291 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:38.095806 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:38.097303 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:38.113452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:38.115029 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:38.115695 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:38.116922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:38.117742 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:38.118409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:38.329692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:38.337457 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:38.339408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:38.340853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6b8eb4af-c965-45ce-ae7a-4952330b5070 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.249762 Sep 11 08:50:38.342048 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 247/524] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:38 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:38.507827 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-58e6e600-dada-432f-870b-baac9f59fe54 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:38.522885 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-58e6e600-dada-432f-870b-baac9f59fe54 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.522649 Sep 11 08:50:38.537009 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 278/525] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:37 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:39.159396 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-886795ba-503e-4655-9fb8-2014eaef696e req-92e047da-837e-46fa-9d8a-8732c8ee354d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223e4b7b-8a6c-4647-aa91-aae73dbeb340", "name": "network-vif-plugged", "status": "completed", "tag": "a3c9ee62-2858-49c8-b169-41636e1c8bdd"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:39.177303 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-886795ba-503e-4655-9fb8-2014eaef696e req-92e047da-837e-46fa-9d8a-8732c8ee354d service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:39.177786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-886795ba-503e-4655-9fb8-2014eaef696e req-92e047da-837e-46fa-9d8a-8732c8ee354d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:39.178365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-886795ba-503e-4655-9fb8-2014eaef696e req-92e047da-837e-46fa-9d8a-8732c8ee354d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:39.193972 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-886795ba-503e-4655-9fb8-2014eaef696e req-92e047da-837e-46fa-9d8a-8732c8ee354d service nova] Creating event network-vif-plugged:a3c9ee62-2858-49c8-b169-41636e1c8bdd for instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 on hv-cinder-85694 Sep 11 08:50:39.201760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-886795ba-503e-4655-9fb8-2014eaef696e req-92e047da-837e-46fa-9d8a-8732c8ee354d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047996 Sep 11 08:50:39.202713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 279/526] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:50:39.294178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-72764e86-ebb4-4675-bbe1-b414c697b435 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Action: 'create', calling method: .version_select at 0x7fb27ecf7af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1414583063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwQb5FgxBD3cqHZLgmRBQYN4vF93ZiLwi7St79Ij/EoyxNX2zB5SkB3R9ZuActvV1p4ZVsirvJHWDjFzsYdrCHM5Fhzm7xPg9xhzSfsqGh4k6ta8FYXpLRNCM/SiscO0A=="}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:39.341739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-72764e86-ebb4-4675-bbe1-b414c697b435 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Getting quotas for project 8035cc960d1f4aed981b1812e4abe6eb. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:50:39.348222 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-72764e86-ebb4-4675-bbe1-b414c697b435 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Getting quotas for user 708d05029cef49a4a7f7cbc78fce77ab and project 8035cc960d1f4aed981b1812e4abe6eb. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:50:39.389360 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:39.389994 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:39.397149 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:39.397851 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:39.398315 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:39.399394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:39.399918 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:39.400501 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:39.432646 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-72764e86-ebb4-4675-bbe1-b414c697b435 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.382917 Sep 11 08:50:39.433307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 248/527] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 08:50:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:50:39.549323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d987a715-faac-4636-9600-58abbeffa5b8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:39.549878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d987a715-faac-4636-9600-58abbeffa5b8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:39.557173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d987a715-faac-4636-9600-58abbeffa5b8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:39.557711 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:39.557967 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d987a715-faac-4636-9600-58abbeffa5b8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:39.558416 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d987a715-faac-4636-9600-58abbeffa5b8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:39.559531 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d987a715-faac-4636-9600-58abbeffa5b8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:39.560038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d987a715-faac-4636-9600-58abbeffa5b8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:39.560458 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d987a715-faac-4636-9600-58abbeffa5b8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:39.569844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:39.572134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:39.573035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-53f8d21d-4c9a-4891-ad9e-31f3195f6d2b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.187956 Sep 11 08:50:39.573798 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 280/528] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:39 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:39.771893 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d987a715-faac-4636-9600-58abbeffa5b8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:39.780581 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d987a715-faac-4636-9600-58abbeffa5b8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.236043 Sep 11 08:50:39.781254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 249/529] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:39 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:50:40.599773 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:40.600379 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:40.607053 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:40.607536 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:40.608441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:40.609399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:40.609852 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:40.611138 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:40.805495 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c1b5bc88-fccc-4608-be4a-25dbf33cee02 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:40.806126 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c1b5bc88-fccc-4608-be4a-25dbf33cee02 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:40.817007 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc88-fccc-4608-be4a-25dbf33cee02 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:40.817508 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc88-fccc-4608-be4a-25dbf33cee02 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:40.817948 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc88-fccc-4608-be4a-25dbf33cee02 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:40.823484 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:40.832894 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc88-fccc-4608-be4a-25dbf33cee02 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:40.833628 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc88-fccc-4608-be4a-25dbf33cee02 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:40.834079 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1b5bc88-fccc-4608-be4a-25dbf33cee02 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:40.836012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:40.838391 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:40.839876 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-01a149bb-053d-46cb-97c3-8c1ae587c6cd tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.244264 Sep 11 08:50:40.851396 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 281/530] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:40 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:41.090777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c1b5bc88-fccc-4608-be4a-25dbf33cee02 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:41.102729 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c1b5bc88-fccc-4608-be4a-25dbf33cee02 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.302378 Sep 11 08:50:41.103266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 250/531] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:40 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:41.868307 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:41.869655 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:41.877641 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:41.878329 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:41.878879 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:41.880524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:41.880857 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:41.881373 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:42.126021 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8a88e358-f9d9-422d-8afd-565c4efe9137 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:42.126918 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8a88e358-f9d9-422d-8afd-565c4efe9137 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:42.137886 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a88e358-f9d9-422d-8afd-565c4efe9137 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:42.137886 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a88e358-f9d9-422d-8afd-565c4efe9137 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:42.137886 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a88e358-f9d9-422d-8afd-565c4efe9137 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:42.137886 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a88e358-f9d9-422d-8afd-565c4efe9137 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:42.138308 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a88e358-f9d9-422d-8afd-565c4efe9137 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:42.138308 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8a88e358-f9d9-422d-8afd-565c4efe9137 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:42.150428 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:42.181378 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:42.208542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:42.210061 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:42.211303 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0bff1544-d885-4fe7-8558-ee8d5576eb99 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.347813 Sep 11 08:50:42.211868 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 282/532] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:41 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:42.373647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8a88e358-f9d9-422d-8afd-565c4efe9137 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:42.382799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8a88e358-f9d9-422d-8afd-565c4efe9137 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.260638 Sep 11 08:50:42.389032 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 251/533] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:42 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:50:43.240526 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:43.241353 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:43.249418 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:43.250067 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:43.250551 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:43.252084 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:43.252537 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:43.252956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:43.412925 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f7d3fd74-3838-49f1-b4ad-a538fe2ad30d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:43.413701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f7d3fd74-3838-49f1-b4ad-a538fe2ad30d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:43.425391 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7d3fd74-3838-49f1-b4ad-a538fe2ad30d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:43.426414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7d3fd74-3838-49f1-b4ad-a538fe2ad30d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:43.428699 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7d3fd74-3838-49f1-b4ad-a538fe2ad30d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:43.429552 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7d3fd74-3838-49f1-b4ad-a538fe2ad30d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:43.430200 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7d3fd74-3838-49f1-b4ad-a538fe2ad30d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:43.430821 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f7d3fd74-3838-49f1-b4ad-a538fe2ad30d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:43.475443 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:43.486223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:43.487983 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:43.489325 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3349b0a0-9d02-413c-8d3c-f6e86396e3c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.254029 Sep 11 08:50:43.508786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 283/534] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:43 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:50:43.648968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f7d3fd74-3838-49f1-b4ad-a538fe2ad30d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:43.663120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f7d3fd74-3838-49f1-b4ad-a538fe2ad30d tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.253062 Sep 11 08:50:43.664719 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 252/535] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:43 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:44.518732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:44.519988 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:44.524430 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-12a9e286-7022-491e-bda3-192eaf313bec tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:44.524982 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-12a9e286-7022-491e-bda3-192eaf313bec tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:44.532277 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:44.532500 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12a9e286-7022-491e-bda3-192eaf313bec tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:44.532854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12a9e286-7022-491e-bda3-192eaf313bec tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:44.533454 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:44.533677 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12a9e286-7022-491e-bda3-192eaf313bec tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:44.534872 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12a9e286-7022-491e-bda3-192eaf313bec tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:44.535496 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12a9e286-7022-491e-bda3-192eaf313bec tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:44.535967 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:44.536277 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-12a9e286-7022-491e-bda3-192eaf313bec tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:44.540770 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:44.541344 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:44.542361 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:44.698956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-12a9e286-7022-491e-bda3-192eaf313bec tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'services' on Instance uuid 1185ff5c-f369-4602-8e3e-c4a1438ed06e {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:50:44.719418 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:44.734595 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:44.736822 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:44.738041 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5279e7ac-5af8-4de9-bcc2-6fc9d033d7f7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1807 microversion: 2.20 time: 0.223808 Sep 11 08:50:44.743512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 284/536] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:44 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:44.765235 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-40c37e60-5712-4edb-85b7-323d2caba279 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:44.767618 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-40c37e60-5712-4edb-85b7-323d2caba279 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:44.775570 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40c37e60-5712-4edb-85b7-323d2caba279 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:44.776272 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40c37e60-5712-4edb-85b7-323d2caba279 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:44.776922 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40c37e60-5712-4edb-85b7-323d2caba279 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:44.777836 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40c37e60-5712-4edb-85b7-323d2caba279 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:44.778468 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40c37e60-5712-4edb-85b7-323d2caba279 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:44.779036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-40c37e60-5712-4edb-85b7-323d2caba279 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:45.011447 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-40c37e60-5712-4edb-85b7-323d2caba279 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:45.016769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-40c37e60-5712-4edb-85b7-323d2caba279 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.271850 Sep 11 08:50:45.017620 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 285/537] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:44 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:45.065998 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-12a9e286-7022-491e-bda3-192eaf313bec tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/os-volume_attachments/0c770e94-020f-40b1-8abb-a4684f07254d" status: 202 len: 0 microversion: 2.1 time: 0.545606 Sep 11 08:50:45.066953 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 253/538] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:50:44 2022] DELETE /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/os-volume_attachments/0c770e94-020f-40b1-8abb-a4684f07254d => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:50:45.770139 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:45.770792 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:45.782796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:45.783422 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:45.783946 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:45.784769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:45.785514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:45.786240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:45.947920 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:45.957306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:45.958881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:45.960180 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-13081d89-969d-490e-8490-10a6404df97a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1794 microversion: 2.20 time: 0.194767 Sep 11 08:50:45.960746 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 286/539] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:50:45 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1794 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:50:46.046205 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a58058b5-0fed-4819-9590-377ad54130dd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:46.046917 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a58058b5-0fed-4819-9590-377ad54130dd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:46.053788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a58058b5-0fed-4819-9590-377ad54130dd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:46.053997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a58058b5-0fed-4819-9590-377ad54130dd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:46.054426 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a58058b5-0fed-4819-9590-377ad54130dd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:46.055142 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a58058b5-0fed-4819-9590-377ad54130dd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:46.055590 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a58058b5-0fed-4819-9590-377ad54130dd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:46.056008 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a58058b5-0fed-4819-9590-377ad54130dd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:46.236005 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a58058b5-0fed-4819-9590-377ad54130dd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:46.244347 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a58058b5-0fed-4819-9590-377ad54130dd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.202724 Sep 11 08:50:46.256479 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 254/540] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:46 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:50:47.269809 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3804eb35-9769-4d90-abbe-5180e6707ecb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:47.271469 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3804eb35-9769-4d90-abbe-5180e6707ecb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:47.278564 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3804eb35-9769-4d90-abbe-5180e6707ecb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:47.279149 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3804eb35-9769-4d90-abbe-5180e6707ecb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:47.279476 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3804eb35-9769-4d90-abbe-5180e6707ecb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:47.280231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3804eb35-9769-4d90-abbe-5180e6707ecb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:47.280681 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3804eb35-9769-4d90-abbe-5180e6707ecb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:47.281100 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3804eb35-9769-4d90-abbe-5180e6707ecb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:47.327129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0644087e-85db-4494-b531-f8233748a303 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:47.334714 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0644087e-85db-4494-b531-f8233748a303 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:47.335223 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0644087e-85db-4494-b531-f8233748a303 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:47.335667 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0644087e-85db-4494-b531-f8233748a303 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:47.361090 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0644087e-85db-4494-b531-f8233748a303 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Going to try to stop instance {{(pid=127647) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 11 08:50:47.454851 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3804eb35-9769-4d90-abbe-5180e6707ecb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:47.463119 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3804eb35-9769-4d90-abbe-5180e6707ecb tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.198035 Sep 11 08:50:47.463691 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 287/541] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:47 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:47.587412 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0644087e-85db-4494-b531-f8233748a303 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "POST /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/action" status: 202 len: 0 microversion: 2.1 time: 0.265018 Sep 11 08:50:47.589793 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 255/542] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:50:47 2022] POST /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 08:50:47.605698 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7de7b935-8e45-45eb-8719-bb9e82535b03 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:47.606594 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7de7b935-8e45-45eb-8719-bb9e82535b03 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:47.619545 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7de7b935-8e45-45eb-8719-bb9e82535b03 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:47.620107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7de7b935-8e45-45eb-8719-bb9e82535b03 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:47.620590 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7de7b935-8e45-45eb-8719-bb9e82535b03 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:47.621925 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7de7b935-8e45-45eb-8719-bb9e82535b03 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:47.623140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7de7b935-8e45-45eb-8719-bb9e82535b03 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:47.623911 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7de7b935-8e45-45eb-8719-bb9e82535b03 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:47.767395 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7de7b935-8e45-45eb-8719-bb9e82535b03 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:47.777774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7de7b935-8e45-45eb-8719-bb9e82535b03 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1673 microversion: 2.1 time: 0.181318 Sep 11 08:50:47.778395 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 288/543] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:47 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:48.488647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2200197a-8e18-4378-90f5-bf9f5ec46d49 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:48.489331 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2200197a-8e18-4378-90f5-bf9f5ec46d49 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:48.491372 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:48.496443 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2200197a-8e18-4378-90f5-bf9f5ec46d49 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:48.496937 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2200197a-8e18-4378-90f5-bf9f5ec46d49 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:48.497442 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2200197a-8e18-4378-90f5-bf9f5ec46d49 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:48.498176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2200197a-8e18-4378-90f5-bf9f5ec46d49 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:48.498627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2200197a-8e18-4378-90f5-bf9f5ec46d49 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:48.499051 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2200197a-8e18-4378-90f5-bf9f5ec46d49 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:48.665089 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2200197a-8e18-4378-90f5-bf9f5ec46d49 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:48.672081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2200197a-8e18-4378-90f5-bf9f5ec46d49 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.188467 Sep 11 08:50:48.673536 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 256/544] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:48 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:48.804597 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6a5720ef-0e32-44b3-b90e-c43b050ee0ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:48.809714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6a5720ef-0e32-44b3-b90e-c43b050ee0ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:48.811708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a5720ef-0e32-44b3-b90e-c43b050ee0ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:48.812195 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a5720ef-0e32-44b3-b90e-c43b050ee0ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:48.812635 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a5720ef-0e32-44b3-b90e-c43b050ee0ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:48.814125 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a5720ef-0e32-44b3-b90e-c43b050ee0ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:48.814700 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a5720ef-0e32-44b3-b90e-c43b050ee0ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:48.815185 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a5720ef-0e32-44b3-b90e-c43b050ee0ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:48.966624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6a5720ef-0e32-44b3-b90e-c43b050ee0ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:48.975194 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6a5720ef-0e32-44b3-b90e-c43b050ee0ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1673 microversion: 2.1 time: 0.174587 Sep 11 08:50:48.975778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 289/545] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:48 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:49.697575 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8e5dab48-4d19-43c2-8509-fb71bb50ed41 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:49.698234 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8e5dab48-4d19-43c2-8509-fb71bb50ed41 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:49.700586 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=4 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:49.706207 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8e5dab48-4d19-43c2-8509-fb71bb50ed41 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:49.706700 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8e5dab48-4d19-43c2-8509-fb71bb50ed41 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:49.707138 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8e5dab48-4d19-43c2-8509-fb71bb50ed41 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:49.707844 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8e5dab48-4d19-43c2-8509-fb71bb50ed41 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:49.708299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8e5dab48-4d19-43c2-8509-fb71bb50ed41 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:49.708728 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8e5dab48-4d19-43c2-8509-fb71bb50ed41 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:49.915617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8e5dab48-4d19-43c2-8509-fb71bb50ed41 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:49.915617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8e5dab48-4d19-43c2-8509-fb71bb50ed41 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.207545 Sep 11 08:50:49.915617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 257/546] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:49 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:50.000975 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6983b001-6f99-4839-ad2d-6f6d2d51940c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:50.001700 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6983b001-6f99-4839-ad2d-6f6d2d51940c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:50.009637 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6983b001-6f99-4839-ad2d-6f6d2d51940c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:50.010329 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6983b001-6f99-4839-ad2d-6f6d2d51940c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:50.010999 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6983b001-6f99-4839-ad2d-6f6d2d51940c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:50.011895 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6983b001-6f99-4839-ad2d-6f6d2d51940c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:50.012352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6983b001-6f99-4839-ad2d-6f6d2d51940c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:50.012998 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6983b001-6f99-4839-ad2d-6f6d2d51940c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:50.216004 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6983b001-6f99-4839-ad2d-6f6d2d51940c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:50.234743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6983b001-6f99-4839-ad2d-6f6d2d51940c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1673 microversion: 2.1 time: 0.237514 Sep 11 08:50:50.239059 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 290/547] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:49 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:50.925080 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-301c89d7-caf6-4bcf-aab0-5982ad41cff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:50.925731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-301c89d7-caf6-4bcf-aab0-5982ad41cff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:50.932006 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-301c89d7-caf6-4bcf-aab0-5982ad41cff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:50.932485 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-301c89d7-caf6-4bcf-aab0-5982ad41cff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:50.932935 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-301c89d7-caf6-4bcf-aab0-5982ad41cff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:50.933608 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-301c89d7-caf6-4bcf-aab0-5982ad41cff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:50.934194 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-301c89d7-caf6-4bcf-aab0-5982ad41cff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:50.934512 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-301c89d7-caf6-4bcf-aab0-5982ad41cff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:51.082814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-301c89d7-caf6-4bcf-aab0-5982ad41cff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:51.091140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-301c89d7-caf6-4bcf-aab0-5982ad41cff5 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1757 microversion: 2.1 time: 0.170519 Sep 11 08:50:51.091705 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 258/548] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:50 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:51.262039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-45bb61b7-13d5-4bfa-8c81-dcb72c7f8351 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:51.263018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-45bb61b7-13d5-4bfa-8c81-dcb72c7f8351 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:51.271570 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45bb61b7-13d5-4bfa-8c81-dcb72c7f8351 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:51.272056 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45bb61b7-13d5-4bfa-8c81-dcb72c7f8351 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:51.272491 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45bb61b7-13d5-4bfa-8c81-dcb72c7f8351 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:51.273182 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45bb61b7-13d5-4bfa-8c81-dcb72c7f8351 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:51.273632 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45bb61b7-13d5-4bfa-8c81-dcb72c7f8351 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:51.274092 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45bb61b7-13d5-4bfa-8c81-dcb72c7f8351 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:51.417841 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-45bb61b7-13d5-4bfa-8c81-dcb72c7f8351 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:51.426217 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-45bb61b7-13d5-4bfa-8c81-dcb72c7f8351 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1673 microversion: 2.1 time: 0.169967 Sep 11 08:50:51.426798 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 291/549] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:51 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:52.114725 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-76642e02-37bd-4946-95df-b61295f4a4a7 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:52.115328 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-76642e02-37bd-4946-95df-b61295f4a4a7 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:52.121794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76642e02-37bd-4946-95df-b61295f4a4a7 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:52.122304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76642e02-37bd-4946-95df-b61295f4a4a7 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:52.122734 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76642e02-37bd-4946-95df-b61295f4a4a7 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:52.123406 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76642e02-37bd-4946-95df-b61295f4a4a7 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:52.123854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76642e02-37bd-4946-95df-b61295f4a4a7 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:52.125146 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-76642e02-37bd-4946-95df-b61295f4a4a7 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:52.279357 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-76642e02-37bd-4946-95df-b61295f4a4a7 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:52.291406 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-76642e02-37bd-4946-95df-b61295f4a4a7 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1760 microversion: 2.1 time: 0.180334 Sep 11 08:50:52.292028 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 259/550] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:52 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1760 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:52.449346 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4ef2ac26-c419-4519-b4ef-8e94cd38e324 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:52.449907 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4ef2ac26-c419-4519-b4ef-8e94cd38e324 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:52.456824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ef2ac26-c419-4519-b4ef-8e94cd38e324 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:52.457312 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ef2ac26-c419-4519-b4ef-8e94cd38e324 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:52.457747 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ef2ac26-c419-4519-b4ef-8e94cd38e324 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:52.458470 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ef2ac26-c419-4519-b4ef-8e94cd38e324 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:52.458928 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ef2ac26-c419-4519-b4ef-8e94cd38e324 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:52.459400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ef2ac26-c419-4519-b4ef-8e94cd38e324 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:52.629169 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4ef2ac26-c419-4519-b4ef-8e94cd38e324 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:52.637354 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4ef2ac26-c419-4519-b4ef-8e94cd38e324 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1673 microversion: 2.1 time: 0.192209 Sep 11 08:50:52.637921 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 292/551] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:52 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1673 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:53.662569 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ab448217-0096-4f9e-8334-cb24188c76fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:53.663173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ab448217-0096-4f9e-8334-cb24188c76fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:53.671353 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab448217-0096-4f9e-8334-cb24188c76fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:53.671845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab448217-0096-4f9e-8334-cb24188c76fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:53.672271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab448217-0096-4f9e-8334-cb24188c76fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:53.672967 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab448217-0096-4f9e-8334-cb24188c76fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:53.674003 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab448217-0096-4f9e-8334-cb24188c76fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:53.674464 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab448217-0096-4f9e-8334-cb24188c76fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:53.822019 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ab448217-0096-4f9e-8334-cb24188c76fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:53.830436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ab448217-0096-4f9e-8334-cb24188c76fd tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1673 microversion: 2.1 time: 0.171666 Sep 11 08:50:53.831014 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 260/552] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:53 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:54.855026 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1bb1c1e8-bc31-477e-9dcd-3c60d1649d6d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:54.855639 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1bb1c1e8-bc31-477e-9dcd-3c60d1649d6d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:54.863166 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bb1c1e8-bc31-477e-9dcd-3c60d1649d6d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:54.863978 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bb1c1e8-bc31-477e-9dcd-3c60d1649d6d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:54.864412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bb1c1e8-bc31-477e-9dcd-3c60d1649d6d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:54.865131 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bb1c1e8-bc31-477e-9dcd-3c60d1649d6d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:54.865588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bb1c1e8-bc31-477e-9dcd-3c60d1649d6d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:54.866014 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1bb1c1e8-bc31-477e-9dcd-3c60d1649d6d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:55.009176 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1bb1c1e8-bc31-477e-9dcd-3c60d1649d6d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:55.017127 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1bb1c1e8-bc31-477e-9dcd-3c60d1649d6d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1673 microversion: 2.1 time: 0.165962 Sep 11 08:50:55.017712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 293/553] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:54 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:56.042093 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-58efbb61-d5ee-4498-b80a-6f5a78c5b3ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:56.043073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-58efbb61-d5ee-4498-b80a-6f5a78c5b3ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:56.058403 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58efbb61-d5ee-4498-b80a-6f5a78c5b3ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:56.058403 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58efbb61-d5ee-4498-b80a-6f5a78c5b3ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:56.058403 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58efbb61-d5ee-4498-b80a-6f5a78c5b3ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:56.058403 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58efbb61-d5ee-4498-b80a-6f5a78c5b3ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:56.058869 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58efbb61-d5ee-4498-b80a-6f5a78c5b3ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:56.058869 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58efbb61-d5ee-4498-b80a-6f5a78c5b3ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:56.189815 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-58efbb61-d5ee-4498-b80a-6f5a78c5b3ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:56.197721 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-58efbb61-d5ee-4498-b80a-6f5a78c5b3ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1673 microversion: 2.1 time: 0.160404 Sep 11 08:50:56.198340 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 261/554] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:56 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:57.221481 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6976a784-7d16-4987-a809-53560fab583e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:57.222027 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6976a784-7d16-4987-a809-53560fab583e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:57.229995 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6976a784-7d16-4987-a809-53560fab583e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:57.230518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6976a784-7d16-4987-a809-53560fab583e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:57.230963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6976a784-7d16-4987-a809-53560fab583e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:57.231669 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6976a784-7d16-4987-a809-53560fab583e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:57.232158 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6976a784-7d16-4987-a809-53560fab583e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:57.232598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6976a784-7d16-4987-a809-53560fab583e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:57.375930 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6976a784-7d16-4987-a809-53560fab583e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:57.385558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6976a784-7d16-4987-a809-53560fab583e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1673 microversion: 2.1 time: 0.168344 Sep 11 08:50:57.386429 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 294/555] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:57 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:58.411228 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7311322e-d6df-483b-80e6-c1645bdbf437 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:58.411797 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-7311322e-d6df-483b-80e6-c1645bdbf437 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:58.418291 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7311322e-d6df-483b-80e6-c1645bdbf437 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:58.418777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7311322e-d6df-483b-80e6-c1645bdbf437 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:58.419211 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7311322e-d6df-483b-80e6-c1645bdbf437 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:58.419900 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7311322e-d6df-483b-80e6-c1645bdbf437 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:58.420351 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7311322e-d6df-483b-80e6-c1645bdbf437 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:58.420772 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7311322e-d6df-483b-80e6-c1645bdbf437 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:58.553698 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7311322e-d6df-483b-80e6-c1645bdbf437 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:58.561485 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-7311322e-d6df-483b-80e6-c1645bdbf437 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1650 microversion: 2.1 time: 0.155051 Sep 11 08:50:58.562055 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 262/556] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:58 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1650 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:58.584715 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-051fad79-c698-430e-ac6a-0f152e1f260a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:50:58.591334 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-051fad79-c698-430e-ac6a-0f152e1f260a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:58.591820 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-051fad79-c698-430e-ac6a-0f152e1f260a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:58.592258 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-051fad79-c698-430e-ac6a-0f152e1f260a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:58.614743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-051fad79-c698-430e-ac6a-0f152e1f260a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Going to try to start instance {{(pid=127646) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 11 08:50:58.619140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:50:58.785732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-051fad79-c698-430e-ac6a-0f152e1f260a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "POST /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/action" status: 202 len: 0 microversion: 2.1 time: 0.204721 Sep 11 08:50:58.786529 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 295/557] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:50:58 2022] POST /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:50:58.794725 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-495b5f12-6773-45e9-a569-a2576f18f222 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:58.795422 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-495b5f12-6773-45e9-a569-a2576f18f222 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:58.801436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-495b5f12-6773-45e9-a569-a2576f18f222 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:58.801977 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-495b5f12-6773-45e9-a569-a2576f18f222 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:58.802383 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-495b5f12-6773-45e9-a569-a2576f18f222 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:58.803309 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-495b5f12-6773-45e9-a569-a2576f18f222 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:58.803860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-495b5f12-6773-45e9-a569-a2576f18f222 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:58.804505 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-495b5f12-6773-45e9-a569-a2576f18f222 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:58.947861 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-495b5f12-6773-45e9-a569-a2576f18f222 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:50:58.955679 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-495b5f12-6773-45e9-a569-a2576f18f222 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1659 microversion: 2.1 time: 0.164789 Sep 11 08:50:58.956257 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 263/558] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:58 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1659 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:50:59.980841 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f95b9e47-d991-4eb8-805c-8e0f127775ff tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:50:59.981581 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f95b9e47-d991-4eb8-805c-8e0f127775ff tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:50:59.988730 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f95b9e47-d991-4eb8-805c-8e0f127775ff tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:59.989221 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f95b9e47-d991-4eb8-805c-8e0f127775ff tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:59.989698 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f95b9e47-d991-4eb8-805c-8e0f127775ff tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:50:59.990439 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f95b9e47-d991-4eb8-805c-8e0f127775ff tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:50:59.990897 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f95b9e47-d991-4eb8-805c-8e0f127775ff tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:50:59.991325 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f95b9e47-d991-4eb8-805c-8e0f127775ff tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:00.141205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f95b9e47-d991-4eb8-805c-8e0f127775ff tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:00.149567 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f95b9e47-d991-4eb8-805c-8e0f127775ff tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1659 microversion: 2.1 time: 0.173621 Sep 11 08:51:00.150168 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 296/559] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:50:59 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1659 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:01.173652 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-54986d11-f89e-4524-94f0-efc3e1a9605d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:01.174405 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-54986d11-f89e-4524-94f0-efc3e1a9605d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:01.181587 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54986d11-f89e-4524-94f0-efc3e1a9605d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:01.182075 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54986d11-f89e-4524-94f0-efc3e1a9605d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:01.182542 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54986d11-f89e-4524-94f0-efc3e1a9605d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:01.183382 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54986d11-f89e-4524-94f0-efc3e1a9605d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:01.183911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54986d11-f89e-4524-94f0-efc3e1a9605d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:01.184336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54986d11-f89e-4524-94f0-efc3e1a9605d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:01.333882 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-54986d11-f89e-4524-94f0-efc3e1a9605d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:01.342451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-54986d11-f89e-4524-94f0-efc3e1a9605d tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1663 microversion: 2.1 time: 0.172983 Sep 11 08:51:01.343179 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 264/560] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:01 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1663 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:04.595103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2076853210", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1414583063", "security_groups": [{"name": "tempest-secgroup-smoke-444552740"}], "networks": [{"uuid": "8956dfa2-07f0-44eb-8150-3f23a698228f"}], "block_device_mapping_v2": [{"uuid": "31a706b6-9451-4aec-b765-9fae55a692d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:04.713354 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] validate_networks() for [('8956dfa2-07f0-44eb-8150-3f23a698228f', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:51:05.106452 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:51:05.106876 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:51:05.107430 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:51:05.107939 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:51:05.108726 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:51:05.120762 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:05.121248 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:05.121682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:05.122441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:05.122893 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:05.123317 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:05.141095 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Getting quotas for project 8035cc960d1f4aed981b1812e4abe6eb. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:51:05.145035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Getting quotas for user 708d05029cef49a4a7f7cbc78fce77ab and project 8035cc960d1f4aed981b1812e4abe6eb. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:51:05.204492 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:51:05.207274 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='31a706b6-9451-4aec-b765-9fae55a692d2',volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:51:05.650400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-887f3f49-4a09-4f8a-a911-a74bddea9fc3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.059096 Sep 11 08:51:05.651186 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 297/561] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:51:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:51:05.663743 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-dfbb0298-09d2-44a9-964e-ebdabdb8473a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:05.664367 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-dfbb0298-09d2-44a9-964e-ebdabdb8473a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:05.726569 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-dfbb0298-09d2-44a9-964e-ebdabdb8473a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:05.733903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-dfbb0298-09d2-44a9-964e-ebdabdb8473a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1089 microversion: 2.1 time: 0.074243 Sep 11 08:51:05.734520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 265/562] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:05 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:06.758411 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f2bcde50-74b0-4d8a-82e8-76198de344a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:06.758998 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f2bcde50-74b0-4d8a-82e8-76198de344a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:06.815220 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f2bcde50-74b0-4d8a-82e8-76198de344a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:06.825493 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f2bcde50-74b0-4d8a-82e8-76198de344a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1089 microversion: 2.1 time: 0.071678 Sep 11 08:51:06.826088 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 298/563] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:06 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:07.848906 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1b1cf63f-8fd7-4041-9101-e1823b16c6df tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:07.849645 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1b1cf63f-8fd7-4041-9101-e1823b16c6df tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:07.857927 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1b1cf63f-8fd7-4041-9101-e1823b16c6df tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:07.858718 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1b1cf63f-8fd7-4041-9101-e1823b16c6df tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:07.859357 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1b1cf63f-8fd7-4041-9101-e1823b16c6df tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:07.860119 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1b1cf63f-8fd7-4041-9101-e1823b16c6df tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:07.860715 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1b1cf63f-8fd7-4041-9101-e1823b16c6df tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:07.861914 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1b1cf63f-8fd7-4041-9101-e1823b16c6df tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:07.958037 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1b1cf63f-8fd7-4041-9101-e1823b16c6df tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:07.966731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1b1cf63f-8fd7-4041-9101-e1823b16c6df tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1187 microversion: 2.1 time: 0.122229 Sep 11 08:51:07.967322 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 266/564] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:07 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:08.991573 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8d7d705c-8af1-40b2-aff2-8f1963487cd6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:08.992514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8d7d705c-8af1-40b2-aff2-8f1963487cd6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:08.995010 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:09.003421 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d7d705c-8af1-40b2-aff2-8f1963487cd6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:09.003918 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d7d705c-8af1-40b2-aff2-8f1963487cd6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:09.004354 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d7d705c-8af1-40b2-aff2-8f1963487cd6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:09.005305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d7d705c-8af1-40b2-aff2-8f1963487cd6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:09.005927 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d7d705c-8af1-40b2-aff2-8f1963487cd6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:09.006403 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d7d705c-8af1-40b2-aff2-8f1963487cd6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:09.078529 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8d7d705c-8af1-40b2-aff2-8f1963487cd6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:09.087545 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8d7d705c-8af1-40b2-aff2-8f1963487cd6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1205 microversion: 2.1 time: 0.099906 Sep 11 08:51:09.088130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 299/565] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:08 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1205 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:10.113822 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ab1739bd-8d7b-434c-bdd4-5625a1a1053d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:10.114745 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ab1739bd-8d7b-434c-bdd4-5625a1a1053d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:10.121283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab1739bd-8d7b-434c-bdd4-5625a1a1053d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:10.121774 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab1739bd-8d7b-434c-bdd4-5625a1a1053d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:10.122246 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab1739bd-8d7b-434c-bdd4-5625a1a1053d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:10.122969 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab1739bd-8d7b-434c-bdd4-5625a1a1053d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:10.123425 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab1739bd-8d7b-434c-bdd4-5625a1a1053d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:10.123854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ab1739bd-8d7b-434c-bdd4-5625a1a1053d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:10.129008 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:10.362319 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ab1739bd-8d7b-434c-bdd4-5625a1a1053d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:10.370122 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ab1739bd-8d7b-434c-bdd4-5625a1a1053d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1272 microversion: 2.1 time: 0.261767 Sep 11 08:51:10.371046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 267/566] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:10 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:10.637003 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-30555eb2-9aab-4135-aea7-fbcb812ab9fd req-e33fdc50-80af-4f3e-9354-8862ced9abd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c90788-7f2f-48f0-bdcb-1b66a5c48f8b", "tag": "d9c7e947-ce3e-4ea3-8867-16f246a7639b"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:10.648515 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-30555eb2-9aab-4135-aea7-fbcb812ab9fd req-e33fdc50-80af-4f3e-9354-8862ced9abd6 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:10.648982 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-30555eb2-9aab-4135-aea7-fbcb812ab9fd req-e33fdc50-80af-4f3e-9354-8862ced9abd6 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:10.649408 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-30555eb2-9aab-4135-aea7-fbcb812ab9fd req-e33fdc50-80af-4f3e-9354-8862ced9abd6 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:10.662440 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-30555eb2-9aab-4135-aea7-fbcb812ab9fd req-e33fdc50-80af-4f3e-9354-8862ced9abd6 service nova] Creating event network-changed:d9c7e947-ce3e-4ea3-8867-16f246a7639b for instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b on hv-cinder-85694 Sep 11 08:51:10.668485 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-30555eb2-9aab-4135-aea7-fbcb812ab9fd req-e33fdc50-80af-4f3e-9354-8862ced9abd6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035205 Sep 11 08:51:10.669408 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 300/567] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:51:11.402125 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b2ca0a27-d9e1-43d7-901d-dd864c23ec6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:11.403276 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b2ca0a27-d9e1-43d7-901d-dd864c23ec6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:11.416076 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a27-d9e1-43d7-901d-dd864c23ec6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:11.416936 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a27-d9e1-43d7-901d-dd864c23ec6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:11.417712 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a27-d9e1-43d7-901d-dd864c23ec6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:11.419015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a27-d9e1-43d7-901d-dd864c23ec6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:11.419854 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a27-d9e1-43d7-901d-dd864c23ec6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:11.420605 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2ca0a27-d9e1-43d7-901d-dd864c23ec6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:11.600920 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b2ca0a27-d9e1-43d7-901d-dd864c23ec6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:11.609575 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b2ca0a27-d9e1-43d7-901d-dd864c23ec6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.215338 Sep 11 08:51:11.610319 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 268/568] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:11 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:12.637867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-135e830d-89d5-48e7-8551-13d155cf2c6b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:12.638519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-135e830d-89d5-48e7-8551-13d155cf2c6b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:12.645973 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-135e830d-89d5-48e7-8551-13d155cf2c6b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:12.646508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-135e830d-89d5-48e7-8551-13d155cf2c6b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:12.646944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-135e830d-89d5-48e7-8551-13d155cf2c6b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:12.647743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-135e830d-89d5-48e7-8551-13d155cf2c6b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:12.648216 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-135e830d-89d5-48e7-8551-13d155cf2c6b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:12.648642 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-135e830d-89d5-48e7-8551-13d155cf2c6b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:12.792220 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-135e830d-89d5-48e7-8551-13d155cf2c6b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:12.800337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-135e830d-89d5-48e7-8551-13d155cf2c6b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.167401 Sep 11 08:51:12.800911 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 301/569] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:12 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:13.823157 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d5085d89-20ca-4294-9c85-acbd7c57512e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:13.823766 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d5085d89-20ca-4294-9c85-acbd7c57512e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:13.830454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5085d89-20ca-4294-9c85-acbd7c57512e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:13.830952 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5085d89-20ca-4294-9c85-acbd7c57512e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:13.831369 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5085d89-20ca-4294-9c85-acbd7c57512e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:13.832064 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5085d89-20ca-4294-9c85-acbd7c57512e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:13.832515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5085d89-20ca-4294-9c85-acbd7c57512e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:13.832942 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d5085d89-20ca-4294-9c85-acbd7c57512e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:13.972993 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d5085d89-20ca-4294-9c85-acbd7c57512e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:13.980988 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d5085d89-20ca-4294-9c85-acbd7c57512e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.161755 Sep 11 08:51:13.981560 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 269/570] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:13 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:15.004075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1877f9d4-0819-4b67-a360-c097b35ba998 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:15.004688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1877f9d4-0819-4b67-a360-c097b35ba998 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:15.011077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1877f9d4-0819-4b67-a360-c097b35ba998 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:15.011563 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1877f9d4-0819-4b67-a360-c097b35ba998 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:15.012015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1877f9d4-0819-4b67-a360-c097b35ba998 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:15.012739 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1877f9d4-0819-4b67-a360-c097b35ba998 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:15.013189 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1877f9d4-0819-4b67-a360-c097b35ba998 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:15.013603 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1877f9d4-0819-4b67-a360-c097b35ba998 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:15.132071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:15.153290 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1877f9d4-0819-4b67-a360-c097b35ba998 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:15.161704 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1877f9d4-0819-4b67-a360-c097b35ba998 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.161536 Sep 11 08:51:15.162307 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 302/571] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:14 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:15.373786 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f014c841-4029-4d45-8caf-e4205a9fbe7a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a728429b-9511-4b79-bf35-1ea1451e6dc1"}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:15.376951 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f014c841-4029-4d45-8caf-e4205a9fbe7a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:15.383490 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f014c841-4029-4d45-8caf-e4205a9fbe7a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:15.383913 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f014c841-4029-4d45-8caf-e4205a9fbe7a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:15.384353 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f014c841-4029-4d45-8caf-e4205a9fbe7a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:15.385055 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f014c841-4029-4d45-8caf-e4205a9fbe7a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:15.385511 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f014c841-4029-4d45-8caf-e4205a9fbe7a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:15.385943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f014c841-4029-4d45-8caf-e4205a9fbe7a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:15.731470 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:16.185927 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2364b95e-5caa-4b2b-af66-53175d25d058 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:16.186635 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2364b95e-5caa-4b2b-af66-53175d25d058 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:16.193614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2364b95e-5caa-4b2b-af66-53175d25d058 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:16.194105 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2364b95e-5caa-4b2b-af66-53175d25d058 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:16.194558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2364b95e-5caa-4b2b-af66-53175d25d058 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:16.195257 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2364b95e-5caa-4b2b-af66-53175d25d058 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:16.195701 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2364b95e-5caa-4b2b-af66-53175d25d058 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:16.196119 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2364b95e-5caa-4b2b-af66-53175d25d058 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:16.217591 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f014c841-4029-4d45-8caf-e4205a9fbe7a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "POST /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847747 Sep 11 08:51:16.218685 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 270/572] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:51:15 2022] POST /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:51:16.342782 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2364b95e-5caa-4b2b-af66-53175d25d058 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:16.350441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2364b95e-5caa-4b2b-af66-53175d25d058 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.168343 Sep 11 08:51:16.351000 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 303/573] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:16 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:17.382138 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8184ab4b-41cc-4c49-97ab-ed40f527696d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:17.382952 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8184ab4b-41cc-4c49-97ab-ed40f527696d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:17.390284 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8184ab4b-41cc-4c49-97ab-ed40f527696d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:17.390895 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8184ab4b-41cc-4c49-97ab-ed40f527696d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:17.391340 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8184ab4b-41cc-4c49-97ab-ed40f527696d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:17.392057 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8184ab4b-41cc-4c49-97ab-ed40f527696d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:17.393361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8184ab4b-41cc-4c49-97ab-ed40f527696d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:17.393987 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8184ab4b-41cc-4c49-97ab-ed40f527696d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:17.546700 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8184ab4b-41cc-4c49-97ab-ed40f527696d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:17.555735 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8184ab4b-41cc-4c49-97ab-ed40f527696d tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.178695 Sep 11 08:51:17.556326 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 271/574] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:17 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:18.581464 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d5a3ab18-109f-4dfc-91e8-25573c51f025 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:18.582037 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d5a3ab18-109f-4dfc-91e8-25573c51f025 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:18.584644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=8 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:18.590729 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5a3ab18-109f-4dfc-91e8-25573c51f025 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:18.591264 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5a3ab18-109f-4dfc-91e8-25573c51f025 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:18.591696 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5a3ab18-109f-4dfc-91e8-25573c51f025 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:18.592415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5a3ab18-109f-4dfc-91e8-25573c51f025 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:18.592848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5a3ab18-109f-4dfc-91e8-25573c51f025 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:18.593264 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5a3ab18-109f-4dfc-91e8-25573c51f025 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:18.736682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d5a3ab18-109f-4dfc-91e8-25573c51f025 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:18.746512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d5a3ab18-109f-4dfc-91e8-25573c51f025 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.170364 Sep 11 08:51:18.747113 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 304/575] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:18 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:19.770787 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9d1ef566-738c-44d1-8486-1aef8650564c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:19.771308 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9d1ef566-738c-44d1-8486-1aef8650564c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:19.773803 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=34 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:19.778877 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d1ef566-738c-44d1-8486-1aef8650564c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:19.779393 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d1ef566-738c-44d1-8486-1aef8650564c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:19.779829 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d1ef566-738c-44d1-8486-1aef8650564c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:19.780529 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d1ef566-738c-44d1-8486-1aef8650564c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:19.781004 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d1ef566-738c-44d1-8486-1aef8650564c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:19.781397 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9d1ef566-738c-44d1-8486-1aef8650564c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:19.920565 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-9d1ef566-738c-44d1-8486-1aef8650564c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:19.928636 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9d1ef566-738c-44d1-8486-1aef8650564c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.162384 Sep 11 08:51:19.929219 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 272/576] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:19 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:20.953480 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d077cf93-5a13-40d5-b22c-3a7e9e224b9a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:20.954097 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d077cf93-5a13-40d5-b22c-3a7e9e224b9a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:20.962957 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d077cf93-5a13-40d5-b22c-3a7e9e224b9a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:20.963451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d077cf93-5a13-40d5-b22c-3a7e9e224b9a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:20.963881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d077cf93-5a13-40d5-b22c-3a7e9e224b9a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:20.964646 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d077cf93-5a13-40d5-b22c-3a7e9e224b9a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:20.965098 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d077cf93-5a13-40d5-b22c-3a7e9e224b9a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:20.965521 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d077cf93-5a13-40d5-b22c-3a7e9e224b9a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:21.096411 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d077cf93-5a13-40d5-b22c-3a7e9e224b9a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:21.104069 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d077cf93-5a13-40d5-b22c-3a7e9e224b9a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.154952 Sep 11 08:51:21.104641 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 305/577] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:20 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:22.127689 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-92dfed60-9f3d-4636-9154-a2e6159210b8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:22.128274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-92dfed60-9f3d-4636-9154-a2e6159210b8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:22.134749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92dfed60-9f3d-4636-9154-a2e6159210b8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:22.135244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92dfed60-9f3d-4636-9154-a2e6159210b8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:22.135681 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92dfed60-9f3d-4636-9154-a2e6159210b8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:22.136373 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92dfed60-9f3d-4636-9154-a2e6159210b8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:22.136826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92dfed60-9f3d-4636-9154-a2e6159210b8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:22.137247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-92dfed60-9f3d-4636-9154-a2e6159210b8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:22.275350 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-92dfed60-9f3d-4636-9154-a2e6159210b8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:22.283890 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-92dfed60-9f3d-4636-9154-a2e6159210b8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.159709 Sep 11 08:51:22.284669 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 273/578] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:22 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:23.307601 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d074520a-8863-48d5-9f59-fdebb6c00d64 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:23.308305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d074520a-8863-48d5-9f59-fdebb6c00d64 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:23.314966 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d074520a-8863-48d5-9f59-fdebb6c00d64 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:23.315445 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d074520a-8863-48d5-9f59-fdebb6c00d64 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:23.315872 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d074520a-8863-48d5-9f59-fdebb6c00d64 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:23.316596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d074520a-8863-48d5-9f59-fdebb6c00d64 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:23.317040 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d074520a-8863-48d5-9f59-fdebb6c00d64 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:23.317452 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d074520a-8863-48d5-9f59-fdebb6c00d64 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:23.461901 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d074520a-8863-48d5-9f59-fdebb6c00d64 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:23.470109 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d074520a-8863-48d5-9f59-fdebb6c00d64 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.166375 Sep 11 08:51:23.471455 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 306/579] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:23 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:24.494736 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-176d2753-c3d0-4621-a89e-5018859d2bcb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:24.495261 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-176d2753-c3d0-4621-a89e-5018859d2bcb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:24.502255 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-176d2753-c3d0-4621-a89e-5018859d2bcb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:24.502742 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-176d2753-c3d0-4621-a89e-5018859d2bcb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:24.503179 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-176d2753-c3d0-4621-a89e-5018859d2bcb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:24.503875 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-176d2753-c3d0-4621-a89e-5018859d2bcb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:24.504331 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-176d2753-c3d0-4621-a89e-5018859d2bcb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:24.504759 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-176d2753-c3d0-4621-a89e-5018859d2bcb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:24.640949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-176d2753-c3d0-4621-a89e-5018859d2bcb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:24.655405 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-176d2753-c3d0-4621-a89e-5018859d2bcb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.164099 Sep 11 08:51:24.656444 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 274/580] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:24 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:25.695458 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d36c95cf-edce-451c-b403-eec0f4840df8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:25.696002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d36c95cf-edce-451c-b403-eec0f4840df8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:25.702473 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d36c95cf-edce-451c-b403-eec0f4840df8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:25.702952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d36c95cf-edce-451c-b403-eec0f4840df8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:25.703377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d36c95cf-edce-451c-b403-eec0f4840df8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:25.704062 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d36c95cf-edce-451c-b403-eec0f4840df8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:25.704507 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d36c95cf-edce-451c-b403-eec0f4840df8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:25.705588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d36c95cf-edce-451c-b403-eec0f4840df8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:25.844939 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d36c95cf-edce-451c-b403-eec0f4840df8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:25.853619 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d36c95cf-edce-451c-b403-eec0f4840df8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.162166 Sep 11 08:51:25.854230 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 307/581] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:25 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:26.878515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0c50b9aa-802d-423b-858d-a19aaad8a4f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:26.879129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0c50b9aa-802d-423b-858d-a19aaad8a4f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:26.886070 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c50b9aa-802d-423b-858d-a19aaad8a4f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:26.886655 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c50b9aa-802d-423b-858d-a19aaad8a4f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:26.887100 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c50b9aa-802d-423b-858d-a19aaad8a4f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:26.887825 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c50b9aa-802d-423b-858d-a19aaad8a4f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:26.888278 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c50b9aa-802d-423b-858d-a19aaad8a4f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:26.888695 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c50b9aa-802d-423b-858d-a19aaad8a4f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:27.033996 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0c50b9aa-802d-423b-858d-a19aaad8a4f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:27.042034 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0c50b9aa-802d-423b-858d-a19aaad8a4f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.168743 Sep 11 08:51:27.042721 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 275/582] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:26 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:28.068534 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-82a12b3b-b1db-421f-9534-219426ae1296 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:28.069374 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-82a12b3b-b1db-421f-9534-219426ae1296 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:28.078077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82a12b3b-b1db-421f-9534-219426ae1296 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:28.078820 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82a12b3b-b1db-421f-9534-219426ae1296 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:28.080042 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82a12b3b-b1db-421f-9534-219426ae1296 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:28.081047 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82a12b3b-b1db-421f-9534-219426ae1296 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:28.081485 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82a12b3b-b1db-421f-9534-219426ae1296 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:28.081920 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82a12b3b-b1db-421f-9534-219426ae1296 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:28.237874 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-82a12b3b-b1db-421f-9534-219426ae1296 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:28.246312 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-82a12b3b-b1db-421f-9534-219426ae1296 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.182354 Sep 11 08:51:28.249096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 308/583] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:28 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:28.870867 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-39e8334c-0bc1-4281-8b09-86d65ea27376 req-26c6b2ae-6372-47f3-aaa1-fbbe3d8e7879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c90788-7f2f-48f0-bdcb-1b66a5c48f8b", "name": "network-vif-plugged", "status": "completed", "tag": "d9c7e947-ce3e-4ea3-8867-16f246a7639b"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:28.882648 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-39e8334c-0bc1-4281-8b09-86d65ea27376 req-26c6b2ae-6372-47f3-aaa1-fbbe3d8e7879 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:28.883129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-39e8334c-0bc1-4281-8b09-86d65ea27376 req-26c6b2ae-6372-47f3-aaa1-fbbe3d8e7879 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:28.883561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-39e8334c-0bc1-4281-8b09-86d65ea27376 req-26c6b2ae-6372-47f3-aaa1-fbbe3d8e7879 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:28.895858 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-39e8334c-0bc1-4281-8b09-86d65ea27376 req-26c6b2ae-6372-47f3-aaa1-fbbe3d8e7879 service nova] Creating event network-vif-plugged:d9c7e947-ce3e-4ea3-8867-16f246a7639b for instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b on hv-cinder-85694 Sep 11 08:51:28.901033 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-39e8334c-0bc1-4281-8b09-86d65ea27376 req-26c6b2ae-6372-47f3-aaa1-fbbe3d8e7879 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034138 Sep 11 08:51:28.901655 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 276/584] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:51:29.270139 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1200322f-bb40-4a10-ac3a-eac622dbe7e7 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:29.271451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1200322f-bb40-4a10-ac3a-eac622dbe7e7 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:29.277699 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1200322f-bb40-4a10-ac3a-eac622dbe7e7 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:29.278203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1200322f-bb40-4a10-ac3a-eac622dbe7e7 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:29.278773 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1200322f-bb40-4a10-ac3a-eac622dbe7e7 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:29.279469 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1200322f-bb40-4a10-ac3a-eac622dbe7e7 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:29.279921 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1200322f-bb40-4a10-ac3a-eac622dbe7e7 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:29.281020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1200322f-bb40-4a10-ac3a-eac622dbe7e7 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:29.284991 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:29.424708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1200322f-bb40-4a10-ac3a-eac622dbe7e7 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:29.432308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1200322f-bb40-4a10-ac3a-eac622dbe7e7 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.166733 Sep 11 08:51:29.432875 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 309/585] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:29 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:30.457986 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ba97a684-0144-4ad3-9c1f-33cb805ce129 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:30.458815 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ba97a684-0144-4ad3-9c1f-33cb805ce129 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:30.465379 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ba97a684-0144-4ad3-9c1f-33cb805ce129 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:30.465867 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ba97a684-0144-4ad3-9c1f-33cb805ce129 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:30.466549 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ba97a684-0144-4ad3-9c1f-33cb805ce129 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:30.467272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ba97a684-0144-4ad3-9c1f-33cb805ce129 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:30.467732 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ba97a684-0144-4ad3-9c1f-33cb805ce129 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:30.468167 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ba97a684-0144-4ad3-9c1f-33cb805ce129 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:30.613121 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ba97a684-0144-4ad3-9c1f-33cb805ce129 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:30.621822 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ba97a684-0144-4ad3-9c1f-33cb805ce129 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1260 microversion: 2.1 time: 0.169603 Sep 11 08:51:30.624873 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 277/586] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:30 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:31.646694 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-424746cb-f8c3-467e-aa3f-aa679a68df13 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:31.647360 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-424746cb-f8c3-467e-aa3f-aa679a68df13 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:31.655886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-424746cb-f8c3-467e-aa3f-aa679a68df13 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:31.656428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-424746cb-f8c3-467e-aa3f-aa679a68df13 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:31.656860 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-424746cb-f8c3-467e-aa3f-aa679a68df13 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:31.657560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-424746cb-f8c3-467e-aa3f-aa679a68df13 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:31.658009 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-424746cb-f8c3-467e-aa3f-aa679a68df13 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:31.658467 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-424746cb-f8c3-467e-aa3f-aa679a68df13 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:31.821856 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-424746cb-f8c3-467e-aa3f-aa679a68df13 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:31.831801 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-424746cb-f8c3-467e-aa3f-aa679a68df13 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1445 microversion: 2.1 time: 0.190639 Sep 11 08:51:31.832861 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 310/587] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:31 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1445 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:31.856033 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0759292b-bfc0-44b8-91a3-5601189adb6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:31.857241 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0759292b-bfc0-44b8-91a3-5601189adb6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:31.865296 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0759292b-bfc0-44b8-91a3-5601189adb6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:31.865296 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0759292b-bfc0-44b8-91a3-5601189adb6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:31.865921 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0759292b-bfc0-44b8-91a3-5601189adb6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:31.866412 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0759292b-bfc0-44b8-91a3-5601189adb6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:31.867042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0759292b-bfc0-44b8-91a3-5601189adb6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:31.867648 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0759292b-bfc0-44b8-91a3-5601189adb6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:32.029828 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0759292b-bfc0-44b8-91a3-5601189adb6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:32.038636 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0759292b-bfc0-44b8-91a3-5601189adb6f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1445 microversion: 2.1 time: 0.187129 Sep 11 08:51:32.039220 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 278/588] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:31 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1445 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:33.411396 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-366fb48d-7a21-4b79-aeb6-e43f57ae2c4b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:33.413761 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-366fb48d-7a21-4b79-aeb6-e43f57ae2c4b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:33.420202 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-366fb48d-7a21-4b79-aeb6-e43f57ae2c4b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:33.420691 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-366fb48d-7a21-4b79-aeb6-e43f57ae2c4b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:33.421123 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-366fb48d-7a21-4b79-aeb6-e43f57ae2c4b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:33.421823 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-366fb48d-7a21-4b79-aeb6-e43f57ae2c4b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:33.423774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-366fb48d-7a21-4b79-aeb6-e43f57ae2c4b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:33.423774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-366fb48d-7a21-4b79-aeb6-e43f57ae2c4b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:33.447173 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-366fb48d-7a21-4b79-aeb6-e43f57ae2c4b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lazy-loading 'flavor' on Instance uuid ecad74b6-c736-4f92-9339-9fe3221c0700 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:51:33.860026 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-366fb48d-7a21-4b79-aeb6-e43f57ae2c4b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "POST /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/action" status: 200 len: 32 microversion: 2.1 time: 0.452828 Sep 11 08:51:33.861824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 311/589] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:51:33 2022] POST /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/action => generated 32 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 08:51:33.883140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ed1d656e-0702-481e-b668-e6d230f1dde3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:33.886284 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ed1d656e-0702-481e-b668-e6d230f1dde3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:33.898113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ed1d656e-0702-481e-b668-e6d230f1dde3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:33.901948 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ed1d656e-0702-481e-b668-e6d230f1dde3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:33.901948 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ed1d656e-0702-481e-b668-e6d230f1dde3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:33.901948 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ed1d656e-0702-481e-b668-e6d230f1dde3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:33.902628 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ed1d656e-0702-481e-b668-e6d230f1dde3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:33.903747 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ed1d656e-0702-481e-b668-e6d230f1dde3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:34.151724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ed1d656e-0702-481e-b668-e6d230f1dde3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:34.161615 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ed1d656e-0702-481e-b668-e6d230f1dde3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.293819 Sep 11 08:51:34.162494 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 279/590] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:33 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:34.895598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-eda046c6-c485-4a17-a98a-abab5bcb84df req-1df281b4-2f95-4f2b-8ea1-8711f4742b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c90788-7f2f-48f0-bdcb-1b66a5c48f8b", "tag": "d9c7e947-ce3e-4ea3-8867-16f246a7639b"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:34.907233 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-eda046c6-c485-4a17-a98a-abab5bcb84df req-1df281b4-2f95-4f2b-8ea1-8711f4742b2b service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:34.908203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-eda046c6-c485-4a17-a98a-abab5bcb84df req-1df281b4-2f95-4f2b-8ea1-8711f4742b2b service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:34.908637 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-eda046c6-c485-4a17-a98a-abab5bcb84df req-1df281b4-2f95-4f2b-8ea1-8711f4742b2b service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:34.921260 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-eda046c6-c485-4a17-a98a-abab5bcb84df req-1df281b4-2f95-4f2b-8ea1-8711f4742b2b service nova] Creating event network-changed:d9c7e947-ce3e-4ea3-8867-16f246a7639b for instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b on hv-cinder-85694 Sep 11 08:51:34.927646 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-eda046c6-c485-4a17-a98a-abab5bcb84df req-1df281b4-2f95-4f2b-8ea1-8711f4742b2b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035712 Sep 11 08:51:34.928277 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 312/591] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:51:35.184806 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e769c7af-f3f2-46e5-9bc5-8b25c785c6c8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:35.185471 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e769c7af-f3f2-46e5-9bc5-8b25c785c6c8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:35.192891 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e769c7af-f3f2-46e5-9bc5-8b25c785c6c8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:35.193381 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e769c7af-f3f2-46e5-9bc5-8b25c785c6c8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:35.193819 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e769c7af-f3f2-46e5-9bc5-8b25c785c6c8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:35.194544 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e769c7af-f3f2-46e5-9bc5-8b25c785c6c8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:35.195007 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e769c7af-f3f2-46e5-9bc5-8b25c785c6c8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:35.195437 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e769c7af-f3f2-46e5-9bc5-8b25c785c6c8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:35.340217 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e769c7af-f3f2-46e5-9bc5-8b25c785c6c8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:35.353113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e769c7af-f3f2-46e5-9bc5-8b25c785c6c8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.171931 Sep 11 08:51:35.353714 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 280/592] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:35 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:36.378226 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ea56220f-d614-4605-a684-aa3a9f434ada tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:36.379051 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ea56220f-d614-4605-a684-aa3a9f434ada tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:36.385694 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea56220f-d614-4605-a684-aa3a9f434ada tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:36.386209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea56220f-d614-4605-a684-aa3a9f434ada tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:36.386641 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea56220f-d614-4605-a684-aa3a9f434ada tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:36.387335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea56220f-d614-4605-a684-aa3a9f434ada tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:36.387814 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea56220f-d614-4605-a684-aa3a9f434ada tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:36.388237 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ea56220f-d614-4605-a684-aa3a9f434ada tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:36.523251 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ea56220f-d614-4605-a684-aa3a9f434ada tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:36.531515 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ea56220f-d614-4605-a684-aa3a9f434ada tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.158246 Sep 11 08:51:36.532087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 313/593] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:36 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:37.317761 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-794325691", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "networks": [{"uuid": "b0a4670b-bd94-436f-8daa-872dcc71130d"}]}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:37.533831 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.network.neutron [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] validate_networks() for [('b0a4670b-bd94-436f-8daa-872dcc71130d', None, None, None, None, None)] {{(pid=127647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:51:37.554889 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ccaddae3-32c2-4b91-9eb7-771686e6f28e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:37.555444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ccaddae3-32c2-4b91-9eb7-771686e6f28e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:37.562385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ccaddae3-32c2-4b91-9eb7-771686e6f28e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:37.562872 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ccaddae3-32c2-4b91-9eb7-771686e6f28e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:37.563303 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ccaddae3-32c2-4b91-9eb7-771686e6f28e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:37.564648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ccaddae3-32c2-4b91-9eb7-771686e6f28e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:37.565104 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ccaddae3-32c2-4b91-9eb7-771686e6f28e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:37.565574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ccaddae3-32c2-4b91-9eb7-771686e6f28e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:37.749332 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ccaddae3-32c2-4b91-9eb7-771686e6f28e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:37.758272 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ccaddae3-32c2-4b91-9eb7-771686e6f28e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.207239 Sep 11 08:51:37.758942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 314/594] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:37 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:37.887187 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Flavor limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:51:37.887600 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Image limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:51:37.888065 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Flavor pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:51:37.888467 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Image pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:51:37.888868 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:51:37.898791 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:37.899472 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:37.899907 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:37.900634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:37.901079 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:37.901501 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:37.918896 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Getting quotas for project 94ceae42bd11404eaea28d523b98126e. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:51:37.922741 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Getting quotas for user bae09cfbf3844b1682d8924e7d9578ee and project 94ceae42bd11404eaea28d523b98126e. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:51:37.934050 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Going to run 1 instances... {{(pid=127647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:51:37.936356 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:51:38.081466 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b635eab7-0d81-46a6-bac3-808f711767c5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767749 Sep 11 08:51:38.082124 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 281/595] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:51:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:51:38.093795 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8a9299e0-d56c-45bb-a47e-9efe73d5d2ac tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:38.094440 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8a9299e0-d56c-45bb-a47e-9efe73d5d2ac tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:38.152024 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8a9299e0-d56c-45bb-a47e-9efe73d5d2ac tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:38.159876 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8a9299e0-d56c-45bb-a47e-9efe73d5d2ac tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1218 microversion: 2.1 time: 0.070117 Sep 11 08:51:38.160447 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 315/596] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:38 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:38.784114 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6697580b-9502-43e6-9596-32538246613a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:38.784733 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6697580b-9502-43e6-9596-32538246613a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:38.793386 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6697580b-9502-43e6-9596-32538246613a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:38.793879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6697580b-9502-43e6-9596-32538246613a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:38.794363 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6697580b-9502-43e6-9596-32538246613a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:38.795074 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6697580b-9502-43e6-9596-32538246613a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:38.795562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6697580b-9502-43e6-9596-32538246613a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:38.795993 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6697580b-9502-43e6-9596-32538246613a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:38.932025 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6697580b-9502-43e6-9596-32538246613a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:38.940431 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6697580b-9502-43e6-9596-32538246613a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.161279 Sep 11 08:51:38.941505 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 282/597] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:38 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:39.183504 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1f7cf0d9-2445-488c-aebb-3c0d2f81a9dd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:39.184063 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1f7cf0d9-2445-488c-aebb-3c0d2f81a9dd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:39.240250 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1f7cf0d9-2445-488c-aebb-3c0d2f81a9dd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:39.247784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1f7cf0d9-2445-488c-aebb-3c0d2f81a9dd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1218 microversion: 2.1 time: 0.068348 Sep 11 08:51:39.248337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 316/598] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:39 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:39.964671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c6a3d123-34e5-4f50-92f9-3b2f88fe7838 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:39.965275 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c6a3d123-34e5-4f50-92f9-3b2f88fe7838 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:39.973252 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6a3d123-34e5-4f50-92f9-3b2f88fe7838 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:39.973735 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6a3d123-34e5-4f50-92f9-3b2f88fe7838 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:39.974198 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6a3d123-34e5-4f50-92f9-3b2f88fe7838 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:39.974938 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6a3d123-34e5-4f50-92f9-3b2f88fe7838 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:39.975551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6a3d123-34e5-4f50-92f9-3b2f88fe7838 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:39.975955 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6a3d123-34e5-4f50-92f9-3b2f88fe7838 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:40.107643 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c6a3d123-34e5-4f50-92f9-3b2f88fe7838 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:40.111976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:40.117341 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c6a3d123-34e5-4f50-92f9-3b2f88fe7838 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.156569 Sep 11 08:51:40.117924 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 283/599] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:39 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:40.271048 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f8d1ba5c-3e89-475b-950a-21af232ef0a1 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:40.271653 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f8d1ba5c-3e89-475b-950a-21af232ef0a1 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:40.278320 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8d1ba5c-3e89-475b-950a-21af232ef0a1 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:40.278826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8d1ba5c-3e89-475b-950a-21af232ef0a1 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:40.279290 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8d1ba5c-3e89-475b-950a-21af232ef0a1 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:40.279980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8d1ba5c-3e89-475b-950a-21af232ef0a1 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:40.280425 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8d1ba5c-3e89-475b-950a-21af232ef0a1 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:40.280843 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f8d1ba5c-3e89-475b-950a-21af232ef0a1 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:40.345274 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f8d1ba5c-3e89-475b-950a-21af232ef0a1 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:40.352961 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f8d1ba5c-3e89-475b-950a-21af232ef0a1 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1270 microversion: 2.1 time: 0.085963 Sep 11 08:51:40.353516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 317/600] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:40 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:41.140449 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-47ce8966-e516-441d-8d2b-7ce745119676 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:41.141000 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-47ce8966-e516-441d-8d2b-7ce745119676 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:41.148569 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47ce8966-e516-441d-8d2b-7ce745119676 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:41.149065 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47ce8966-e516-441d-8d2b-7ce745119676 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:41.149495 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47ce8966-e516-441d-8d2b-7ce745119676 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:41.150830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47ce8966-e516-441d-8d2b-7ce745119676 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:41.151592 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47ce8966-e516-441d-8d2b-7ce745119676 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:41.152015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47ce8966-e516-441d-8d2b-7ce745119676 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:41.296175 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-47ce8966-e516-441d-8d2b-7ce745119676 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:41.305325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-47ce8966-e516-441d-8d2b-7ce745119676 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.169369 Sep 11 08:51:41.305919 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 284/601] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:41 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:41.376508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4d6ecdaa-9ed5-46d8-9145-21300f965c6b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:41.378636 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4d6ecdaa-9ed5-46d8-9145-21300f965c6b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:41.383565 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4d6ecdaa-9ed5-46d8-9145-21300f965c6b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:41.384049 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4d6ecdaa-9ed5-46d8-9145-21300f965c6b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:41.384478 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4d6ecdaa-9ed5-46d8-9145-21300f965c6b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:41.385170 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4d6ecdaa-9ed5-46d8-9145-21300f965c6b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:41.385618 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4d6ecdaa-9ed5-46d8-9145-21300f965c6b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:41.386118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4d6ecdaa-9ed5-46d8-9145-21300f965c6b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:41.464486 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4d6ecdaa-9ed5-46d8-9145-21300f965c6b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:41.472389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4d6ecdaa-9ed5-46d8-9145-21300f965c6b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1276 microversion: 2.1 time: 0.099883 Sep 11 08:51:41.472974 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 318/602] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:41 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:42.330675 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-84c939f0-e13d-435b-a467-3f9155053093 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:42.332557 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-84c939f0-e13d-435b-a467-3f9155053093 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:42.337716 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84c939f0-e13d-435b-a467-3f9155053093 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:42.338235 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84c939f0-e13d-435b-a467-3f9155053093 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:42.338686 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84c939f0-e13d-435b-a467-3f9155053093 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:42.339392 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84c939f0-e13d-435b-a467-3f9155053093 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:42.339986 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84c939f0-e13d-435b-a467-3f9155053093 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:42.340421 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84c939f0-e13d-435b-a467-3f9155053093 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:42.479524 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-84c939f0-e13d-435b-a467-3f9155053093 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:42.489283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-84c939f0-e13d-435b-a467-3f9155053093 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.162527 Sep 11 08:51:42.490050 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 285/603] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:42 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:42.511297 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d5cb06bf-24da-4fb0-9330-fcccff7d2460 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:42.511935 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d5cb06bf-24da-4fb0-9330-fcccff7d2460 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:42.519587 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5cb06bf-24da-4fb0-9330-fcccff7d2460 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:42.522958 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5cb06bf-24da-4fb0-9330-fcccff7d2460 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:42.522958 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5cb06bf-24da-4fb0-9330-fcccff7d2460 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:42.522958 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5cb06bf-24da-4fb0-9330-fcccff7d2460 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:42.522958 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5cb06bf-24da-4fb0-9330-fcccff7d2460 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:42.523366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d5cb06bf-24da-4fb0-9330-fcccff7d2460 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:42.699170 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d5cb06bf-24da-4fb0-9330-fcccff7d2460 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:42.708503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d5cb06bf-24da-4fb0-9330-fcccff7d2460 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1318 microversion: 2.1 time: 0.201074 Sep 11 08:51:42.709196 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 319/604] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:42 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:42.772321 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-e7efac81-8657-4170-a320-01086c5fcd2b req-39fdbc0a-7fb8-4d4c-a38c-b1abdb8caea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "078e3f41-48de-40ee-aa49-325547437728", "tag": "d255b39d-ddad-478e-9681-9d6513dd3d8a"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:42.782316 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-e7efac81-8657-4170-a320-01086c5fcd2b req-39fdbc0a-7fb8-4d4c-a38c-b1abdb8caea8 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:42.782883 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-e7efac81-8657-4170-a320-01086c5fcd2b req-39fdbc0a-7fb8-4d4c-a38c-b1abdb8caea8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:42.783405 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-e7efac81-8657-4170-a320-01086c5fcd2b req-39fdbc0a-7fb8-4d4c-a38c-b1abdb8caea8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:42.794940 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-e7efac81-8657-4170-a320-01086c5fcd2b req-39fdbc0a-7fb8-4d4c-a38c-b1abdb8caea8 service nova] Creating event network-changed:d255b39d-ddad-478e-9681-9d6513dd3d8a for instance 078e3f41-48de-40ee-aa49-325547437728 on hv-cinder-85694 Sep 11 08:51:42.800791 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-e7efac81-8657-4170-a320-01086c5fcd2b req-39fdbc0a-7fb8-4d4c-a38c-b1abdb8caea8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032146 Sep 11 08:51:42.801275 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 286/605] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:51:43.514842 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a8683775-a8da-4cc0-9fa8-c57138b6bef5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:43.515440 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a8683775-a8da-4cc0-9fa8-c57138b6bef5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:43.517485 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=46 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:43.522169 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a8683775-a8da-4cc0-9fa8-c57138b6bef5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:43.527085 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a8683775-a8da-4cc0-9fa8-c57138b6bef5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:43.527085 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a8683775-a8da-4cc0-9fa8-c57138b6bef5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:43.527085 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a8683775-a8da-4cc0-9fa8-c57138b6bef5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:43.527085 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a8683775-a8da-4cc0-9fa8-c57138b6bef5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:43.527420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a8683775-a8da-4cc0-9fa8-c57138b6bef5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:43.667704 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a8683775-a8da-4cc0-9fa8-c57138b6bef5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:43.676083 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a8683775-a8da-4cc0-9fa8-c57138b6bef5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.165269 Sep 11 08:51:43.676660 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 320/606] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:43 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:43.734170 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b7ea3e6d-f746-4975-b2cc-94bf1102f9aa tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:43.734857 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b7ea3e6d-f746-4975-b2cc-94bf1102f9aa tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:43.741003 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ea3e6d-f746-4975-b2cc-94bf1102f9aa tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:43.741478 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ea3e6d-f746-4975-b2cc-94bf1102f9aa tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:43.741911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ea3e6d-f746-4975-b2cc-94bf1102f9aa tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:43.742631 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ea3e6d-f746-4975-b2cc-94bf1102f9aa tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:43.743082 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ea3e6d-f746-4975-b2cc-94bf1102f9aa tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:43.743501 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7ea3e6d-f746-4975-b2cc-94bf1102f9aa tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:43.873326 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b7ea3e6d-f746-4975-b2cc-94bf1102f9aa tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:43.881617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b7ea3e6d-f746-4975-b2cc-94bf1102f9aa tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1318 microversion: 2.1 time: 0.152409 Sep 11 08:51:43.882208 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 287/607] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:43 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:44.220365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-134c4cd1-bd03-4bfe-9cb3-6e6f06d78d2f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1885598602"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:44.220853 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-134c4cd1-bd03-4bfe-9cb3-6e6f06d78d2f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:44.226838 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-134c4cd1-bd03-4bfe-9cb3-6e6f06d78d2f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:44.227371 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-134c4cd1-bd03-4bfe-9cb3-6e6f06d78d2f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:44.227800 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-134c4cd1-bd03-4bfe-9cb3-6e6f06d78d2f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:44.228480 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-134c4cd1-bd03-4bfe-9cb3-6e6f06d78d2f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:44.228923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-134c4cd1-bd03-4bfe-9cb3-6e6f06d78d2f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:44.229339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-134c4cd1-bd03-4bfe-9cb3-6e6f06d78d2f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:44.360123 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.network.security_group_api [None req-134c4cd1-bd03-4bfe-9cb3-6e6f06d78d2f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Removing security group ea3ba507-74a2-424e-a74e-3ed015c08b60 from port fa04f10d-c16c-4338-8893-20b0b4de7866 Sep 11 08:51:44.701086 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-38a0b19c-0e31-4796-9bf7-5a84a9151037 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:44.704849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-38a0b19c-0e31-4796-9bf7-5a84a9151037 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:44.709029 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-38a0b19c-0e31-4796-9bf7-5a84a9151037 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:44.709678 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-38a0b19c-0e31-4796-9bf7-5a84a9151037 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:44.710351 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-38a0b19c-0e31-4796-9bf7-5a84a9151037 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:44.711266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-38a0b19c-0e31-4796-9bf7-5a84a9151037 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:44.711818 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-38a0b19c-0e31-4796-9bf7-5a84a9151037 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:44.712341 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-38a0b19c-0e31-4796-9bf7-5a84a9151037 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:44.746674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-134c4cd1-bd03-4bfe-9cb3-6e6f06d78d2f tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "POST /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/action" status: 202 len: 0 microversion: 2.1 time: 0.530828 Sep 11 08:51:44.755693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 321/608] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:51:44 2022] POST /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 08:51:44.818629 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-5798efe8-c0f6-419a-af1b-140ee4dac28c req-2db1989d-d09b-4d77-a5cd-dac9a75eef01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2520cc9-8413-40ef-9b12-b5914bff16e2", "tag": "fa04f10d-c16c-4338-8893-20b0b4de7866"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:44.828602 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-5798efe8-c0f6-419a-af1b-140ee4dac28c req-2db1989d-d09b-4d77-a5cd-dac9a75eef01 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:44.829115 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-5798efe8-c0f6-419a-af1b-140ee4dac28c req-2db1989d-d09b-4d77-a5cd-dac9a75eef01 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:44.829543 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-5798efe8-c0f6-419a-af1b-140ee4dac28c req-2db1989d-d09b-4d77-a5cd-dac9a75eef01 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:44.842843 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-5798efe8-c0f6-419a-af1b-140ee4dac28c req-2db1989d-d09b-4d77-a5cd-dac9a75eef01 service nova] Creating event network-changed:fa04f10d-c16c-4338-8893-20b0b4de7866 for instance a2520cc9-8413-40ef-9b12-b5914bff16e2 on hv-cinder-85694 Sep 11 08:51:44.849665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-5798efe8-c0f6-419a-af1b-140ee4dac28c req-2db1989d-d09b-4d77-a5cd-dac9a75eef01 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036221 Sep 11 08:51:44.850447 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 322/609] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:51:44.907722 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6cb3c79a-5ffa-40fc-855a-965ee93ee3a9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:44.908866 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6cb3c79a-5ffa-40fc-855a-965ee93ee3a9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:44.915141 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6cb3c79a-5ffa-40fc-855a-965ee93ee3a9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:44.915763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6cb3c79a-5ffa-40fc-855a-965ee93ee3a9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:44.916307 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6cb3c79a-5ffa-40fc-855a-965ee93ee3a9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:44.917112 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6cb3c79a-5ffa-40fc-855a-965ee93ee3a9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:44.917978 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6cb3c79a-5ffa-40fc-855a-965ee93ee3a9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:44.918821 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6cb3c79a-5ffa-40fc-855a-965ee93ee3a9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:44.942234 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-38a0b19c-0e31-4796-9bf7-5a84a9151037 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:44.960065 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-38a0b19c-0e31-4796-9bf7-5a84a9151037 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.262548 Sep 11 08:51:44.961550 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 288/610] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:44 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:45.211604 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6cb3c79a-5ffa-40fc-855a-965ee93ee3a9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:45.225167 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6cb3c79a-5ffa-40fc-855a-965ee93ee3a9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1318 microversion: 2.1 time: 0.323540 Sep 11 08:51:45.225951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 323/611] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:44 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:45.989297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4f782c4e-7b59-4305-8c2a-7880f7410395 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:45.989894 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4f782c4e-7b59-4305-8c2a-7880f7410395 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:45.996606 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f782c4e-7b59-4305-8c2a-7880f7410395 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:45.997099 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f782c4e-7b59-4305-8c2a-7880f7410395 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:46.003233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f782c4e-7b59-4305-8c2a-7880f7410395 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:46.003233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f782c4e-7b59-4305-8c2a-7880f7410395 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:46.003233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f782c4e-7b59-4305-8c2a-7880f7410395 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:46.003233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f782c4e-7b59-4305-8c2a-7880f7410395 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:46.151781 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4f782c4e-7b59-4305-8c2a-7880f7410395 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:46.160154 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4f782c4e-7b59-4305-8c2a-7880f7410395 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.174827 Sep 11 08:51:46.160740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 289/612] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:45 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:46.251483 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8f81ef4e-65c1-4268-ad61-7c794a59926e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:46.252094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8f81ef4e-65c1-4268-ad61-7c794a59926e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:46.259008 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8f81ef4e-65c1-4268-ad61-7c794a59926e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:46.259509 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8f81ef4e-65c1-4268-ad61-7c794a59926e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:46.259956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8f81ef4e-65c1-4268-ad61-7c794a59926e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:46.260796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8f81ef4e-65c1-4268-ad61-7c794a59926e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:46.261255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8f81ef4e-65c1-4268-ad61-7c794a59926e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:46.261684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8f81ef4e-65c1-4268-ad61-7c794a59926e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:46.497625 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8f81ef4e-65c1-4268-ad61-7c794a59926e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:46.505803 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8f81ef4e-65c1-4268-ad61-7c794a59926e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1318 microversion: 2.1 time: 0.260811 Sep 11 08:51:46.506403 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 324/613] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:46 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:46.772781 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8bce1f34-b507-44a5-ad00-7c9c47e03e35 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:46.773738 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8bce1f34-b507-44a5-ad00-7c9c47e03e35 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:46.783159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bce1f34-b507-44a5-ad00-7c9c47e03e35 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:46.783889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bce1f34-b507-44a5-ad00-7c9c47e03e35 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:46.784540 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bce1f34-b507-44a5-ad00-7c9c47e03e35 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:46.785610 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bce1f34-b507-44a5-ad00-7c9c47e03e35 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:46.786337 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bce1f34-b507-44a5-ad00-7c9c47e03e35 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:46.786995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bce1f34-b507-44a5-ad00-7c9c47e03e35 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:46.867175 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-6d6bfa30-8bd7-4e05-9daf-6c2f2e6c1fe2 req-863ec282-04fd-4ba0-8c97-cbb9070bc4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2520cc9-8413-40ef-9b12-b5914bff16e2", "tag": "fa04f10d-c16c-4338-8893-20b0b4de7866"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:46.877748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-6d6bfa30-8bd7-4e05-9daf-6c2f2e6c1fe2 req-863ec282-04fd-4ba0-8c97-cbb9070bc4c9 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:46.878488 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-6d6bfa30-8bd7-4e05-9daf-6c2f2e6c1fe2 req-863ec282-04fd-4ba0-8c97-cbb9070bc4c9 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:46.878992 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-6d6bfa30-8bd7-4e05-9daf-6c2f2e6c1fe2 req-863ec282-04fd-4ba0-8c97-cbb9070bc4c9 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:46.888950 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-8bce1f34-b507-44a5-ad00-7c9c47e03e35 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lazy-loading 'services' on Instance uuid a2520cc9-8413-40ef-9b12-b5914bff16e2 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:51:46.892498 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-6d6bfa30-8bd7-4e05-9daf-6c2f2e6c1fe2 req-863ec282-04fd-4ba0-8c97-cbb9070bc4c9 service nova] Creating event network-changed:fa04f10d-c16c-4338-8893-20b0b4de7866 for instance a2520cc9-8413-40ef-9b12-b5914bff16e2 on hv-cinder-85694 Sep 11 08:51:46.899442 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-6d6bfa30-8bd7-4e05-9daf-6c2f2e6c1fe2 req-863ec282-04fd-4ba0-8c97-cbb9070bc4c9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035832 Sep 11 08:51:46.900494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 325/614] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:51:47.087237 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8bce1f34-b507-44a5-ad00-7c9c47e03e35 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments/cb43054f-b219-4fd9-9858-486f0197f2a5" status: 202 len: 0 microversion: 2.1 time: 0.318475 Sep 11 08:51:47.089034 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 290/615] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:51:46 2022] DELETE /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments/cb43054f-b219-4fd9-9858-486f0197f2a5 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:51:47.098554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-13e3ed74-f45c-49d4-bd58-e5bca588296a tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:47.100839 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-13e3ed74-f45c-49d4-bd58-e5bca588296a tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:47.114163 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13e3ed74-f45c-49d4-bd58-e5bca588296a tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:47.115155 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13e3ed74-f45c-49d4-bd58-e5bca588296a tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:47.115705 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13e3ed74-f45c-49d4-bd58-e5bca588296a tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:47.116618 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13e3ed74-f45c-49d4-bd58-e5bca588296a tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:47.117318 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13e3ed74-f45c-49d4-bd58-e5bca588296a tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:47.117879 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-13e3ed74-f45c-49d4-bd58-e5bca588296a tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:47.157838 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-13e3ed74-f45c-49d4-bd58-e5bca588296a tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064172 Sep 11 08:51:47.158440 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 326/616] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:51:47 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:51:47.184673 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0b1c259a-60af-4732-9861-ec6bd27c19e8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:47.185545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0b1c259a-60af-4732-9861-ec6bd27c19e8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:47.192539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b1c259a-60af-4732-9861-ec6bd27c19e8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:47.193028 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b1c259a-60af-4732-9861-ec6bd27c19e8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:47.193536 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b1c259a-60af-4732-9861-ec6bd27c19e8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:47.194271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b1c259a-60af-4732-9861-ec6bd27c19e8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:47.194727 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b1c259a-60af-4732-9861-ec6bd27c19e8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:47.195149 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b1c259a-60af-4732-9861-ec6bd27c19e8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:47.351561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0b1c259a-60af-4732-9861-ec6bd27c19e8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:47.360362 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0b1c259a-60af-4732-9861-ec6bd27c19e8 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.179908 Sep 11 08:51:47.360944 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 291/617] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:47 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:47.528901 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7b1b569f-9376-44b0-9b01-fb540d0ce603 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:47.529659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7b1b569f-9376-44b0-9b01-fb540d0ce603 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:47.536437 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7b1b569f-9376-44b0-9b01-fb540d0ce603 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:47.537017 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7b1b569f-9376-44b0-9b01-fb540d0ce603 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:47.537357 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7b1b569f-9376-44b0-9b01-fb540d0ce603 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:47.538065 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7b1b569f-9376-44b0-9b01-fb540d0ce603 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:47.538730 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7b1b569f-9376-44b0-9b01-fb540d0ce603 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:47.539167 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7b1b569f-9376-44b0-9b01-fb540d0ce603 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:47.627002 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9882939e-d937-4ed2-bb2b-fac3498014f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:47.627503 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9882939e-d937-4ed2-bb2b-fac3498014f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:47.633926 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9882939e-d937-4ed2-bb2b-fac3498014f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:47.634448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9882939e-d937-4ed2-bb2b-fac3498014f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:47.634884 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9882939e-d937-4ed2-bb2b-fac3498014f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:47.635580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9882939e-d937-4ed2-bb2b-fac3498014f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:47.636024 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9882939e-d937-4ed2-bb2b-fac3498014f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:47.636741 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9882939e-d937-4ed2-bb2b-fac3498014f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:47.680348 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9882939e-d937-4ed2-bb2b-fac3498014f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments/7aa2fe37-fa13-4364-82f5-64991df83607" status: 200 len: 194 microversion: 2.20 time: 0.057491 Sep 11 08:51:47.686393 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 292/618] 10.222.0.44 () {60 vars in 1454 bytes} [Sun Sep 11 08:51:47 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments/7aa2fe37-fa13-4364-82f5-64991df83607 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:51:47.713665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7b1b569f-9376-44b0-9b01-fb540d0ce603 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:47.728896 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7b1b569f-9376-44b0-9b01-fb540d0ce603 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1318 microversion: 2.1 time: 0.201882 Sep 11 08:51:47.731080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 327/619] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:47 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:47.792053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6ce364d1-8efa-4601-b366-f9f30d50deb9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:47.792559 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6ce364d1-8efa-4601-b366-f9f30d50deb9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:47.807287 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ce364d1-8efa-4601-b366-f9f30d50deb9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:47.808027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ce364d1-8efa-4601-b366-f9f30d50deb9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:47.809117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ce364d1-8efa-4601-b366-f9f30d50deb9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:47.810086 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ce364d1-8efa-4601-b366-f9f30d50deb9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:47.810778 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ce364d1-8efa-4601-b366-f9f30d50deb9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:47.811374 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ce364d1-8efa-4601-b366-f9f30d50deb9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:47.835453 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-db2e267f-516e-4814-b922-bb8ebf18b44d req-86b4de7c-98a6-45a5-9d79-9dc7b5b2ad8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078e3f41-48de-40ee-aa49-325547437728", "name": "network-vif-plugged", "status": "completed", "tag": "d255b39d-ddad-478e-9681-9d6513dd3d8a"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:47.846759 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-db2e267f-516e-4814-b922-bb8ebf18b44d req-86b4de7c-98a6-45a5-9d79-9dc7b5b2ad8e service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:47.847382 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-db2e267f-516e-4814-b922-bb8ebf18b44d req-86b4de7c-98a6-45a5-9d79-9dc7b5b2ad8e service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:47.847904 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-db2e267f-516e-4814-b922-bb8ebf18b44d req-86b4de7c-98a6-45a5-9d79-9dc7b5b2ad8e service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:47.851600 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:47.866717 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-db2e267f-516e-4814-b922-bb8ebf18b44d req-86b4de7c-98a6-45a5-9d79-9dc7b5b2ad8e service nova] Creating event network-vif-plugged:d255b39d-ddad-478e-9681-9d6513dd3d8a for instance 078e3f41-48de-40ee-aa49-325547437728 on hv-cinder-85694 Sep 11 08:51:47.872832 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-db2e267f-516e-4814-b922-bb8ebf18b44d req-86b4de7c-98a6-45a5-9d79-9dc7b5b2ad8e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048028 Sep 11 08:51:47.873581 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 328/620] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:51:47.910422 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:47.924814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-6ce364d1-8efa-4601-b366-f9f30d50deb9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lazy-loading 'services' on Instance uuid 223e4b7b-8a6c-4647-aa91-aae73dbeb340 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:51:47.929802 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=6 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:48.171913 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e0a6941d-8b63-4884-b4f5-8a73532c9be1 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:48.175202 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e0a6941d-8b63-4884-b4f5-8a73532c9be1 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:48.182634 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e0a6941d-8b63-4884-b4f5-8a73532c9be1 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:48.183130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e0a6941d-8b63-4884-b4f5-8a73532c9be1 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:48.183566 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e0a6941d-8b63-4884-b4f5-8a73532c9be1 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:48.185134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e0a6941d-8b63-4884-b4f5-8a73532c9be1 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:48.185623 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e0a6941d-8b63-4884-b4f5-8a73532c9be1 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:48.186263 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e0a6941d-8b63-4884-b4f5-8a73532c9be1 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:48.195059 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6ce364d1-8efa-4601-b366-f9f30d50deb9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "DELETE /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments/7aa2fe37-fa13-4364-82f5-64991df83607" status: 202 len: 0 microversion: 2.20 time: 0.411419 Sep 11 08:51:48.196178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 293/621] 10.222.0.44 () {60 vars in 1457 bytes} [Sun Sep 11 08:51:47 2022] DELETE /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments/7aa2fe37-fa13-4364-82f5-64991df83607 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:51:48.205654 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3c91d1f8-e295-4e1b-bc9e-e6ea75d044e6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:48.208099 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3c91d1f8-e295-4e1b-bc9e-e6ea75d044e6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:48.215061 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c91d1f8-e295-4e1b-bc9e-e6ea75d044e6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:48.215548 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c91d1f8-e295-4e1b-bc9e-e6ea75d044e6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:48.215975 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c91d1f8-e295-4e1b-bc9e-e6ea75d044e6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:48.216741 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c91d1f8-e295-4e1b-bc9e-e6ea75d044e6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:48.217190 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c91d1f8-e295-4e1b-bc9e-e6ea75d044e6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:48.222913 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3c91d1f8-e295-4e1b-bc9e-e6ea75d044e6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:48.225742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e0a6941d-8b63-4884-b4f5-8a73532c9be1 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058636 Sep 11 08:51:48.226364 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 329/622] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:51:48 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:51:48.248970 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3c91d1f8-e295-4e1b-bc9e-e6ea75d044e6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048351 Sep 11 08:51:48.249528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 294/623] 10.222.0.44 () {60 vars in 1343 bytes} [Sun Sep 11 08:51:48 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:51:48.384668 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-23e83216-ced2-4fe6-90a1-ce7c65c6d43c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:48.385443 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-23e83216-ced2-4fe6-90a1-ce7c65c6d43c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:48.393396 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-23e83216-ced2-4fe6-90a1-ce7c65c6d43c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:48.394248 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-23e83216-ced2-4fe6-90a1-ce7c65c6d43c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:48.394796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-23e83216-ced2-4fe6-90a1-ce7c65c6d43c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:48.396034 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-23e83216-ced2-4fe6-90a1-ce7c65c6d43c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:48.396562 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-23e83216-ced2-4fe6-90a1-ce7c65c6d43c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:48.397062 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-23e83216-ced2-4fe6-90a1-ce7c65c6d43c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:48.606057 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-23e83216-ced2-4fe6-90a1-ce7c65c6d43c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:48.616340 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-23e83216-ced2-4fe6-90a1-ce7c65c6d43c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.235550 Sep 11 08:51:48.616940 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 330/624] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:48 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:48.755608 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-09c025ec-add2-4856-8e0d-f1aef835c54d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:48.756260 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-09c025ec-add2-4856-8e0d-f1aef835c54d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:48.763653 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09c025ec-add2-4856-8e0d-f1aef835c54d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:48.764276 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09c025ec-add2-4856-8e0d-f1aef835c54d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:48.764990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09c025ec-add2-4856-8e0d-f1aef835c54d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:48.766083 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09c025ec-add2-4856-8e0d-f1aef835c54d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:48.766846 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09c025ec-add2-4856-8e0d-f1aef835c54d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:48.767540 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09c025ec-add2-4856-8e0d-f1aef835c54d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:48.915056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-09c025ec-add2-4856-8e0d-f1aef835c54d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:48.923220 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-09c025ec-add2-4856-8e0d-f1aef835c54d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1318 microversion: 2.1 time: 0.172746 Sep 11 08:51:48.923819 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 295/625] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:48 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:49.238871 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e960f4f6-61aa-4e40-921c-b245263154f2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:49.240963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e960f4f6-61aa-4e40-921c-b245263154f2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:49.246139 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=4 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:49.248008 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e960f4f6-61aa-4e40-921c-b245263154f2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:49.248573 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e960f4f6-61aa-4e40-921c-b245263154f2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:49.249002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e960f4f6-61aa-4e40-921c-b245263154f2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:49.249698 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e960f4f6-61aa-4e40-921c-b245263154f2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:49.250167 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e960f4f6-61aa-4e40-921c-b245263154f2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:49.251232 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e960f4f6-61aa-4e40-921c-b245263154f2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:49.261272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-77fdfe39-6c28-4b38-a854-78ad7d2e86ed tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:49.263695 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-77fdfe39-6c28-4b38-a854-78ad7d2e86ed tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:49.270571 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77fdfe39-6c28-4b38-a854-78ad7d2e86ed tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:49.270979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77fdfe39-6c28-4b38-a854-78ad7d2e86ed tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:49.272165 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77fdfe39-6c28-4b38-a854-78ad7d2e86ed tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:49.272887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77fdfe39-6c28-4b38-a854-78ad7d2e86ed tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:49.273343 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77fdfe39-6c28-4b38-a854-78ad7d2e86ed tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:49.273765 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-77fdfe39-6c28-4b38-a854-78ad7d2e86ed tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:49.281166 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e960f4f6-61aa-4e40-921c-b245263154f2 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047166 Sep 11 08:51:49.281756 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 331/626] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:51:49 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 08:51:49.292389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:49.292930 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:49.299169 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:49.299650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:49.300076 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:49.300761 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:49.301203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:49.301623 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:49.307201 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-77fdfe39-6c28-4b38-a854-78ad7d2e86ed tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050080 Sep 11 08:51:49.307775 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 296/627] 10.222.0.44 () {60 vars in 1343 bytes} [Sun Sep 11 08:51:49 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:51:49.422852 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] HTTP exception thrown: Instance a2520cc9-8413-40ef-9b12-b5914bff16e2 is not attached to volume cb43054f-b219-4fd9-9858-486f0197f2a5 Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Request method failure captured: Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: DELETE /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments/cb43054f-b219-4fd9-9858-486f0197f2a5 HTTP/1.1 Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaDXnUwtjdB3DOliISZA0FysB2Aqk_Mh1mj6HwTTqDqG767KlMzAUamqR-oltORIB0jg9lT2qBM-CboZMjozN0v00BFCXq_L6aw1TSTlVfNfl9vj0U90iLOMXDdljA9-AzeRD3S4iF7vFb9GPLh1QihuGCbtyxtdHkuWS4S4GhK5Te0 Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: b4f426194c8d41bcaee7862c5d04b180 Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-TestMinimumBasicScenario-2038564111 Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:51:49.428209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:51:49.429742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b4f426194c8d41bcaee7862c5d04b180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b4f426194c8d41bcaee7862c5d04b180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b4f426194c8d41bcaee7862c5d04b180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b4f426194c8d41bcaee7862c5d04b180", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:51:49.429742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-TestMinimumBasicScenario-2038564111 Sep 11 08:51:49.429742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: b4f426194c8d41bcaee7862c5d04b180 Sep 11 08:51:49.429742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2038564111 Sep 11 08:51:49.429742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-TestMinimumBasicScenario-2038564111-project Sep 11 08:51:49.429742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:51:49.429742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:51:49.429742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: a0dde6aa81204252b66b6e640b343ac3 Sep 11 08:51:49.429742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-TestMinimumBasicScenario-2038564111-project Sep 11 08:51:49.429742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:51:49.429742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance a2520cc9-8413-40ef-9b12-b5914bff16e2 is not attached to volume cb43054f-b219-4fd9-9858-486f0197f2a5 Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'server_id': 'a2520cc9-8413-40ef-9b12-b5914bff16e2', 'id': 'cb43054f-b219-4fd9-9858-486f0197f2a5'} Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cb43054f-b219-4fd9-9858-486f0197f2a5. Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:51:49.430713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2520cc9-8413-40ef-9b12-b5914bff16e2 is not attached to volume cb43054f-b219-4fd9-9858-486f0197f2a5 Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2520cc9-8413-40ef-9b12-b5914bff16e2 is not attached to volume cb43054f-b219-4fd9-9858-486f0197f2a5 Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:51:49.432080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Returning 404 to user: Instance a2520cc9-8413-40ef-9b12-b5914bff16e2 is not attached to volume cb43054f-b219-4fd9-9858-486f0197f2a5 {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:51:49.433151 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-11d5adae-b837-4137-84da-5a54072ec595 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments/cb43054f-b219-4fd9-9858-486f0197f2a5" status: 404 len: 154 microversion: 2.1 time: 0.141063 Sep 11 08:51:49.433151 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 332/628] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:51:49 2022] DELETE /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2/os-volume_attachments/cb43054f-b219-4fd9-9858-486f0197f2a5 => generated 154 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 08:51:49.640351 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ebd4cb1f-ad5e-4fe6-a8ba-9be89ac7decd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:49.641102 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ebd4cb1f-ad5e-4fe6-a8ba-9be89ac7decd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:49.647603 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ebd4cb1f-ad5e-4fe6-a8ba-9be89ac7decd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:49.648084 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ebd4cb1f-ad5e-4fe6-a8ba-9be89ac7decd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:49.648519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ebd4cb1f-ad5e-4fe6-a8ba-9be89ac7decd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:49.649215 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ebd4cb1f-ad5e-4fe6-a8ba-9be89ac7decd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:49.649665 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ebd4cb1f-ad5e-4fe6-a8ba-9be89ac7decd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:49.650087 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ebd4cb1f-ad5e-4fe6-a8ba-9be89ac7decd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:49.804163 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ebd4cb1f-ad5e-4fe6-a8ba-9be89ac7decd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:49.812571 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ebd4cb1f-ad5e-4fe6-a8ba-9be89ac7decd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.175997 Sep 11 08:51:49.813166 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 297/629] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:49 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:49.945478 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0b95f0f1-963f-4b4a-817e-919f88a3017a tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:49.946091 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0b95f0f1-963f-4b4a-817e-919f88a3017a tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:49.953148 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b95f0f1-963f-4b4a-817e-919f88a3017a tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:49.954207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b95f0f1-963f-4b4a-817e-919f88a3017a tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:49.954649 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b95f0f1-963f-4b4a-817e-919f88a3017a tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:49.955343 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b95f0f1-963f-4b4a-817e-919f88a3017a tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:49.955796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b95f0f1-963f-4b4a-817e-919f88a3017a tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:49.956222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b95f0f1-963f-4b4a-817e-919f88a3017a tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:50.092415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0b95f0f1-963f-4b4a-817e-919f88a3017a tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:50.101541 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0b95f0f1-963f-4b4a-817e-919f88a3017a tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1318 microversion: 2.1 time: 0.159943 Sep 11 08:51:50.102113 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 333/630] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:49 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:50.320868 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-01cc5486-3f70-4c12-bf1f-8cad43f4d537 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:50.323163 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-01cc5486-3f70-4c12-bf1f-8cad43f4d537 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:50.325895 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:50.330783 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-01cc5486-3f70-4c12-bf1f-8cad43f4d537 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:50.331315 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-01cc5486-3f70-4c12-bf1f-8cad43f4d537 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:50.331692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-01cc5486-3f70-4c12-bf1f-8cad43f4d537 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:50.332380 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-01cc5486-3f70-4c12-bf1f-8cad43f4d537 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:50.332913 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-01cc5486-3f70-4c12-bf1f-8cad43f4d537 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:50.333485 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-01cc5486-3f70-4c12-bf1f-8cad43f4d537 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:50.365795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-01cc5486-3f70-4c12-bf1f-8cad43f4d537 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049216 Sep 11 08:51:50.369969 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 298/631] 10.222.0.44 () {60 vars in 1343 bytes} [Sun Sep 11 08:51:50 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:51:50.703296 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-352b480c-f2ef-4b55-9074-9a34f44f9df4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:50.704385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-352b480c-f2ef-4b55-9074-9a34f44f9df4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:50.711170 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-352b480c-f2ef-4b55-9074-9a34f44f9df4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:50.711911 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-352b480c-f2ef-4b55-9074-9a34f44f9df4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:50.712575 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-352b480c-f2ef-4b55-9074-9a34f44f9df4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:50.713633 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-352b480c-f2ef-4b55-9074-9a34f44f9df4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:50.714374 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-352b480c-f2ef-4b55-9074-9a34f44f9df4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:50.715024 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-352b480c-f2ef-4b55-9074-9a34f44f9df4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:50.743027 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-352b480c-f2ef-4b55-9074-9a34f44f9df4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Going to try to terminate instance {{(pid=127646) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:51:50.838135 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-307cff91-019c-4ae1-af5e-1b5683845a78 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:50.838779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-307cff91-019c-4ae1-af5e-1b5683845a78 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:50.845316 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-307cff91-019c-4ae1-af5e-1b5683845a78 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:50.845800 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-307cff91-019c-4ae1-af5e-1b5683845a78 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:50.846269 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-307cff91-019c-4ae1-af5e-1b5683845a78 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:50.846962 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-307cff91-019c-4ae1-af5e-1b5683845a78 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:50.847414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-307cff91-019c-4ae1-af5e-1b5683845a78 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:50.847840 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-307cff91-019c-4ae1-af5e-1b5683845a78 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:50.976465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-307cff91-019c-4ae1-af5e-1b5683845a78 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:50.979932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:50.985747 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-307cff91-019c-4ae1-af5e-1b5683845a78 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.151535 Sep 11 08:51:50.986368 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 299/632] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:50 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:51.052247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-352b480c-f2ef-4b55-9074-9a34f44f9df4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 204 len: 0 microversion: 2.1 time: 0.352474 Sep 11 08:51:51.052929 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 334/633] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:51:50 2022] DELETE /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:51:51.061258 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bf810c16-d99e-4074-bd66-fbef3defba9e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:51.061870 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bf810c16-d99e-4074-bd66-fbef3defba9e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:51.069216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf810c16-d99e-4074-bd66-fbef3defba9e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:51.069700 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf810c16-d99e-4074-bd66-fbef3defba9e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:51.070131 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf810c16-d99e-4074-bd66-fbef3defba9e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:51.070850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf810c16-d99e-4074-bd66-fbef3defba9e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:51.071302 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf810c16-d99e-4074-bd66-fbef3defba9e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:51.071726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bf810c16-d99e-4074-bd66-fbef3defba9e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:51.126095 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b1672462-eff9-4c8b-bb99-03e9019168f5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:51.126870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b1672462-eff9-4c8b-bb99-03e9019168f5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:51.132801 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b1672462-eff9-4c8b-bb99-03e9019168f5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:51.133293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b1672462-eff9-4c8b-bb99-03e9019168f5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:51.133731 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b1672462-eff9-4c8b-bb99-03e9019168f5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:51.134525 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b1672462-eff9-4c8b-bb99-03e9019168f5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:51.134981 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b1672462-eff9-4c8b-bb99-03e9019168f5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:51.135403 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b1672462-eff9-4c8b-bb99-03e9019168f5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:51.204543 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bf810c16-d99e-4074-bd66-fbef3defba9e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:51.212481 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bf810c16-d99e-4074-bd66-fbef3defba9e tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1554 microversion: 2.1 time: 0.155008 Sep 11 08:51:51.213058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 300/634] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:51 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:51.268544 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b1672462-eff9-4c8b-bb99-03e9019168f5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:51.276439 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b1672462-eff9-4c8b-bb99-03e9019168f5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1508 microversion: 2.1 time: 0.154619 Sep 11 08:51:51.277003 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 335/635] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:51 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:51.379445 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f91dff79-5334-4cd8-bf5a-a02593e11dbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:51.381910 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f91dff79-5334-4cd8-bf5a-a02593e11dbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:51.388504 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f91dff79-5334-4cd8-bf5a-a02593e11dbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:51.388994 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f91dff79-5334-4cd8-bf5a-a02593e11dbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:51.389432 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f91dff79-5334-4cd8-bf5a-a02593e11dbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:51.390233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f91dff79-5334-4cd8-bf5a-a02593e11dbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:51.390784 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f91dff79-5334-4cd8-bf5a-a02593e11dbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:51.391778 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f91dff79-5334-4cd8-bf5a-a02593e11dbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:51.424945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f91dff79-5334-4cd8-bf5a-a02593e11dbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049892 Sep 11 08:51:51.425533 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 301/636] 10.222.0.44 () {60 vars in 1343 bytes} [Sun Sep 11 08:51:51 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:51.491740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-68ad08f8-20dd-45e7-bf92-1473bc5197b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:51.492257 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-68ad08f8-20dd-45e7-bf92-1473bc5197b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:51.498061 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68ad08f8-20dd-45e7-bf92-1473bc5197b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:51.498574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68ad08f8-20dd-45e7-bf92-1473bc5197b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:51.499002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68ad08f8-20dd-45e7-bf92-1473bc5197b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:51.499684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68ad08f8-20dd-45e7-bf92-1473bc5197b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:51.500130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68ad08f8-20dd-45e7-bf92-1473bc5197b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:51.501108 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68ad08f8-20dd-45e7-bf92-1473bc5197b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:51.527748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-68ad08f8-20dd-45e7-bf92-1473bc5197b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Going to try to terminate instance {{(pid=127646) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:51:51.862499 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-68ad08f8-20dd-45e7-bf92-1473bc5197b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "DELETE /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 204 len: 0 microversion: 2.20 time: 0.370174 Sep 11 08:51:51.863402 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 336/637] 10.222.0.44 () {60 vars in 1280 bytes} [Sun Sep 11 08:51:51 2022] DELETE /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 08:51:51.872242 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:51.873259 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:51.881159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:51.884698 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:51.889903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:51.890764 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:51.893183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:51.893183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:52.009559 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4118aee7-db7f-4e34-a1de-6398f77fff27 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:52.010295 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4118aee7-db7f-4e34-a1de-6398f77fff27 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:52.017301 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4118aee7-db7f-4e34-a1de-6398f77fff27 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:52.017791 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4118aee7-db7f-4e34-a1de-6398f77fff27 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:52.018267 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4118aee7-db7f-4e34-a1de-6398f77fff27 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:52.019014 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4118aee7-db7f-4e34-a1de-6398f77fff27 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:52.019391 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4118aee7-db7f-4e34-a1de-6398f77fff27 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:52.019806 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4118aee7-db7f-4e34-a1de-6398f77fff27 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:52.039627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:52.063062 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:52.064795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:52.066069 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ad790ebd-7f04-4df1-99c7-02dd823bc0d2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.198096 Sep 11 08:51:52.067055 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 302/638] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:51:51 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:51:52.159218 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4118aee7-db7f-4e34-a1de-6398f77fff27 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:52.167359 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4118aee7-db7f-4e34-a1de-6398f77fff27 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.162127 Sep 11 08:51:52.167916 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 337/639] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:52 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:52.237488 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ca8225b2-3588-4a97-9063-2e3398cd9773 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:52.238104 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ca8225b2-3588-4a97-9063-2e3398cd9773 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:52.244065 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca8225b2-3588-4a97-9063-2e3398cd9773 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:52.244544 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca8225b2-3588-4a97-9063-2e3398cd9773 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:52.244975 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca8225b2-3588-4a97-9063-2e3398cd9773 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:52.245659 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca8225b2-3588-4a97-9063-2e3398cd9773 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:52.246107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca8225b2-3588-4a97-9063-2e3398cd9773 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:52.246552 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca8225b2-3588-4a97-9063-2e3398cd9773 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:52.383251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ca8225b2-3588-4a97-9063-2e3398cd9773 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:52.392703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ca8225b2-3588-4a97-9063-2e3398cd9773 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1554 microversion: 2.1 time: 0.159903 Sep 11 08:51:52.394316 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 303/640] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:52 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:53.095250 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:53.095906 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:53.103410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:53.103602 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:53.104036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:53.104728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:53.105255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:53.105688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:53.190786 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7e392b51-8b6d-4aa4-a665-ac7cf9932114 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:53.191402 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-7e392b51-8b6d-4aa4-a665-ac7cf9932114 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:53.197468 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7e392b51-8b6d-4aa4-a665-ac7cf9932114 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:53.197992 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7e392b51-8b6d-4aa4-a665-ac7cf9932114 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:53.198463 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7e392b51-8b6d-4aa4-a665-ac7cf9932114 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:53.199165 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7e392b51-8b6d-4aa4-a665-ac7cf9932114 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:53.199762 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7e392b51-8b6d-4aa4-a665-ac7cf9932114 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:53.200192 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7e392b51-8b6d-4aa4-a665-ac7cf9932114 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:53.243449 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:53.253553 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:53.255057 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:53.256263 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-bda5995d-1fd3-45be-b913-60c02271376c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.166193 Sep 11 08:51:53.256822 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 338/641] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:51:53 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:51:53.339134 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7e392b51-8b6d-4aa4-a665-ac7cf9932114 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:53.351705 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-7e392b51-8b6d-4aa4-a665-ac7cf9932114 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.165566 Sep 11 08:51:53.352307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 304/642] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:53 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:53.417028 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d8d16799-62ce-4ab9-bef4-4d116c0da348 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:53.417651 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d8d16799-62ce-4ab9-bef4-4d116c0da348 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:53.424220 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d8d16799-62ce-4ab9-bef4-4d116c0da348 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:53.424704 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d8d16799-62ce-4ab9-bef4-4d116c0da348 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:53.425133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d8d16799-62ce-4ab9-bef4-4d116c0da348 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:53.425819 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d8d16799-62ce-4ab9-bef4-4d116c0da348 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:53.426292 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d8d16799-62ce-4ab9-bef4-4d116c0da348 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:53.426713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d8d16799-62ce-4ab9-bef4-4d116c0da348 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:53.557589 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d8d16799-62ce-4ab9-bef4-4d116c0da348 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:53.565851 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d8d16799-62ce-4ab9-bef4-4d116c0da348 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1554 microversion: 2.1 time: 0.152744 Sep 11 08:51:53.566447 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 339/643] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:53 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:54.281267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:54.282653 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:54.289295 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:54.289784 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:54.290247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:54.290950 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:54.291408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:54.291830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:54.376951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-52b2be05-2ec1-4d1a-8c49-9e6e712820c5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:54.377582 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-52b2be05-2ec1-4d1a-8c49-9e6e712820c5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:54.384840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52b2be05-2ec1-4d1a-8c49-9e6e712820c5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:54.385457 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52b2be05-2ec1-4d1a-8c49-9e6e712820c5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:54.385964 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52b2be05-2ec1-4d1a-8c49-9e6e712820c5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:54.386774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52b2be05-2ec1-4d1a-8c49-9e6e712820c5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:54.387296 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52b2be05-2ec1-4d1a-8c49-9e6e712820c5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:54.387848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52b2be05-2ec1-4d1a-8c49-9e6e712820c5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:54.427078 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:54.435783 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:54.437230 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:54.438961 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-654f3199-4c21-4ead-a360-d4bfc582d700 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.161634 Sep 11 08:51:54.439523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 305/644] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:51:54 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:51:54.525127 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-52b2be05-2ec1-4d1a-8c49-9e6e712820c5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:54.533446 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-52b2be05-2ec1-4d1a-8c49-9e6e712820c5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.161045 Sep 11 08:51:54.534009 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 340/645] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:54 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:54.588860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c57d90e0-38c4-4ca3-a282-82aebe74d4d8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:54.589464 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c57d90e0-38c4-4ca3-a282-82aebe74d4d8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:54.595466 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c57d90e0-38c4-4ca3-a282-82aebe74d4d8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:54.595996 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c57d90e0-38c4-4ca3-a282-82aebe74d4d8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:54.596569 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c57d90e0-38c4-4ca3-a282-82aebe74d4d8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:54.597305 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c57d90e0-38c4-4ca3-a282-82aebe74d4d8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:54.597780 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c57d90e0-38c4-4ca3-a282-82aebe74d4d8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:54.598254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c57d90e0-38c4-4ca3-a282-82aebe74d4d8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:54.735496 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c57d90e0-38c4-4ca3-a282-82aebe74d4d8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:54.743297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c57d90e0-38c4-4ca3-a282-82aebe74d4d8 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1554 microversion: 2.1 time: 0.158420 Sep 11 08:51:54.743942 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 306/646] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:54 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:55.465039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:55.465565 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:55.471946 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:55.472425 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:55.472855 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:55.473546 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:55.473997 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:55.474448 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:55.556774 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c88c41f1-4b2b-48a4-a061-530f12ad6d0e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:55.557388 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c88c41f1-4b2b-48a4-a061-530f12ad6d0e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:55.563952 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c88c41f1-4b2b-48a4-a061-530f12ad6d0e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:55.564450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c88c41f1-4b2b-48a4-a061-530f12ad6d0e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:55.564879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c88c41f1-4b2b-48a4-a061-530f12ad6d0e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:55.565582 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c88c41f1-4b2b-48a4-a061-530f12ad6d0e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:55.566036 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c88c41f1-4b2b-48a4-a061-530f12ad6d0e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:55.566508 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c88c41f1-4b2b-48a4-a061-530f12ad6d0e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:55.646716 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:55.655067 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:55.656564 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:55.657732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f3c7e1e9-488e-437b-acd0-ab0d9f2fae8e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.196725 Sep 11 08:51:55.658320 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 341/647] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:51:55 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:51:55.767881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1ad25cf9-b5dd-4c80-ba35-3767b04609cd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:55.768516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1ad25cf9-b5dd-4c80-ba35-3767b04609cd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:55.772705 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c88c41f1-4b2b-48a4-a061-530f12ad6d0e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:55.776732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ad25cf9-b5dd-4c80-ba35-3767b04609cd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:55.779027 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ad25cf9-b5dd-4c80-ba35-3767b04609cd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:55.780384 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ad25cf9-b5dd-4c80-ba35-3767b04609cd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:55.783470 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ad25cf9-b5dd-4c80-ba35-3767b04609cd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:55.784128 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ad25cf9-b5dd-4c80-ba35-3767b04609cd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:55.784729 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ad25cf9-b5dd-4c80-ba35-3767b04609cd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:55.790359 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:51:55.791303 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c88c41f1-4b2b-48a4-a061-530f12ad6d0e tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.238300 Sep 11 08:51:55.792892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 307/648] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:55 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:56.110453 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1ad25cf9-b5dd-4c80-ba35-3767b04609cd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:56.117971 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1ad25cf9-b5dd-4c80-ba35-3767b04609cd tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1554 microversion: 2.1 time: 0.354584 Sep 11 08:51:56.118576 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 342/649] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:55 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1554 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:56.684824 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:56.685447 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:56.693960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:56.694548 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:56.694994 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:56.695816 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:56.696359 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:56.696786 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:56.863778 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:56.880806 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:56.885828 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:56.888099 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-edba29ce-1cf1-4e1f-b59c-e88b1571165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1722 microversion: 2.20 time: 0.207422 Sep 11 08:51:56.889837 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 308/650] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:51:56 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:51:56.983323 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-811f4db3-3d89-44ae-98a2-9fbb2edfee71 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:56.984598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-811f4db3-3d89-44ae-98a2-9fbb2edfee71 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:56.994215 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811f4db3-3d89-44ae-98a2-9fbb2edfee71 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:56.994709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811f4db3-3d89-44ae-98a2-9fbb2edfee71 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:56.995182 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811f4db3-3d89-44ae-98a2-9fbb2edfee71 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:56.995888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811f4db3-3d89-44ae-98a2-9fbb2edfee71 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:56.996345 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811f4db3-3d89-44ae-98a2-9fbb2edfee71 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:56.996947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-811f4db3-3d89-44ae-98a2-9fbb2edfee71 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:57.102284 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-8fcc316c-549a-4112-9901-8da2427f19b5 req-1373517b-6d75-488e-82cf-94f2ba047e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2520cc9-8413-40ef-9b12-b5914bff16e2", "name": "network-vif-deleted", "tag": "fa04f10d-c16c-4338-8893-20b0b4de7866"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:57.113107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-8fcc316c-549a-4112-9901-8da2427f19b5 req-1373517b-6d75-488e-82cf-94f2ba047e2d service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:57.113583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-8fcc316c-549a-4112-9901-8da2427f19b5 req-1373517b-6d75-488e-82cf-94f2ba047e2d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:57.114139 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-8fcc316c-549a-4112-9901-8da2427f19b5 req-1373517b-6d75-488e-82cf-94f2ba047e2d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:57.127625 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-8fcc316c-549a-4112-9901-8da2427f19b5 req-1373517b-6d75-488e-82cf-94f2ba047e2d service nova] Creating event network-vif-deleted:fa04f10d-c16c-4338-8893-20b0b4de7866 for instance a2520cc9-8413-40ef-9b12-b5914bff16e2 on hv-cinder-85694 Sep 11 08:51:57.133186 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-8fcc316c-549a-4112-9901-8da2427f19b5 req-1373517b-6d75-488e-82cf-94f2ba047e2d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034920 Sep 11 08:51:57.133956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 309/651] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:51:57.142524 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c45c1831-01a0-42b8-8b72-f00e6153223c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:57.143224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c45c1831-01a0-42b8-8b72-f00e6153223c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:57.150301 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c45c1831-01a0-42b8-8b72-f00e6153223c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:57.150900 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c45c1831-01a0-42b8-8b72-f00e6153223c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:57.151489 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c45c1831-01a0-42b8-8b72-f00e6153223c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:57.152215 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c45c1831-01a0-42b8-8b72-f00e6153223c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:57.152885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c45c1831-01a0-42b8-8b72-f00e6153223c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:57.153452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c45c1831-01a0-42b8-8b72-f00e6153223c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:57.231627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c45c1831-01a0-42b8-8b72-f00e6153223c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:57.241180 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c45c1831-01a0-42b8-8b72-f00e6153223c tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1512 microversion: 2.1 time: 0.104064 Sep 11 08:51:57.241771 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 310/652] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:57 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1512 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:57.283321 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-811f4db3-3d89-44ae-98a2-9fbb2edfee71 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:57.299280 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-811f4db3-3d89-44ae-98a2-9fbb2edfee71 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1736 microversion: 2.1 time: 0.483982 Sep 11 08:51:57.302553 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 343/653] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:56 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1736 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:57.923546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:57.924971 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:57.940399 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:57.941984 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:57.943064 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:57.949477 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:57.949968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:57.950628 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:58.072343 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:58.082306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:58.083866 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:58.085239 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-757a4518-38ca-441e-800a-518cf2725ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1654 microversion: 2.20 time: 0.169404 Sep 11 08:51:58.085847 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 311/654] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:51:57 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1654 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:51:58.267657 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:58.268325 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:58.279931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:58.280531 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:58.281040 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:58.282440 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:58.283115 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:58.283874 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:58.325578 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6af128d7-cd0f-40e5-9595-7b7d57b0b5f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:58.326361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6af128d7-cd0f-40e5-9595-7b7d57b0b5f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:58.335229 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:58.336185 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6af128d7-cd0f-40e5-9595-7b7d57b0b5f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:58.336882 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6af128d7-cd0f-40e5-9595-7b7d57b0b5f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:58.337463 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6af128d7-cd0f-40e5-9595-7b7d57b0b5f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:58.338861 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:58.339336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:58.339720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6af128d7-cd0f-40e5-9595-7b7d57b0b5f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:58.339831 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lazy-loading 'fault' on Instance uuid a2520cc9-8413-40ef-9b12-b5914bff16e2 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:51:58.340202 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6af128d7-cd0f-40e5-9595-7b7d57b0b5f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:58.341610 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6af128d7-cd0f-40e5-9595-7b7d57b0b5f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:58.423227 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0dde6aa81204252b66b6e640b343ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f426194c8d41bcaee7862c5d04b180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:58.440199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-14912bec-e01d-426b-b5a5-d46fd05fae30 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 200 len: 1348 microversion: 2.1 time: 0.178902 Sep 11 08:51:58.440796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 344/655] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:58 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 1348 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:58.525318 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6af128d7-cd0f-40e5-9595-7b7d57b0b5f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:58.534592 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6af128d7-cd0f-40e5-9595-7b7d57b0b5f9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1716 microversion: 2.1 time: 0.213280 Sep 11 08:51:58.541138 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 312/656] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:58 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1716 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:51:58.616949 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:58.617639 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:58.624096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:58.624692 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:58.625556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:58.626548 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:58.627015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:58.627440 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:58.738360 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] HTTP exception thrown: Cannot 'detach_volume' instance ecad74b6-c736-4f92-9339-9fe3221c0700 while it is in vm_state rescued Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Request method failure captured: Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: DELETE /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments/a728429b-9511-4b79-bf35-1ea1451e6dc1 HTTP/1.1 Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaCAu486B1xOWjzoN32Ui9eEOSqsCt3PPO76qh3QezPV599Kfd26fIVevOl2XWy4ljtSLDXXhbgXhEByiOZUCykRIKveORgcox18nSEtMQfNksuGMDm5LQpWcCuCK28TkehgbbHx8cYJignj8hbMDx_f29oWsYlEYPPugfePpJOGrDM Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: bcb554b6cf504ca9a30a1ea871364e3d Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:51:58.740682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:51:58.742243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bcb554b6cf504ca9a30a1ea871364e3d", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:51:58.742243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:51:58.742243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: bcb554b6cf504ca9a30a1ea871364e3d Sep 11 08:51:58.742243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:51:58.742243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-ServerRescueNegativeTestJSON-1061498163-project Sep 11 08:51:58.742243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:51:58.742243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:51:58.742243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: 2aea4a0e0ec74c538735b890fb774b14 Sep 11 08:51:58.742243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1061498163-project Sep 11 08:51:58.742243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:51:58.742243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Cannot 'detach_volume' instance ecad74b6-c736-4f92-9339-9fe3221c0700 while it is in vm_state rescued Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'server_id': 'ecad74b6-c736-4f92-9339-9fe3221c0700', 'id': 'a728429b-9511-4b79-bf35-1ea1451e6dc1'} Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ecad74b6-c736-4f92-9339-9fe3221c0700 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:51:58.743754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ecad74b6-c736-4f92-9339-9fe3221c0700 while it is in vm_state rescued Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ecad74b6-c736-4f92-9339-9fe3221c0700 while it is in vm_state rescued Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:51:58.745626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Returning 409 to user: Cannot 'detach_volume' instance ecad74b6-c736-4f92-9339-9fe3221c0700 while it is in vm_state rescued {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:51:58.747059 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-471e6a3e-0285-40d3-91e6-54d541c4dddb tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments/a728429b-9511-4b79-bf35-1ea1451e6dc1" status: 409 len: 152 microversion: 2.1 time: 0.129686 Sep 11 08:51:58.747059 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 345/657] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:51:58 2022] DELETE /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments/a728429b-9511-4b79-bf35-1ea1451e6dc1 => generated 152 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 11 08:51:58.752968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-84a17cd2-3e88-46ba-9294-29ff628382c6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:58.754337 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-84a17cd2-3e88-46ba-9294-29ff628382c6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:58.760820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a17cd2-3e88-46ba-9294-29ff628382c6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:58.761405 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a17cd2-3e88-46ba-9294-29ff628382c6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:58.761910 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a17cd2-3e88-46ba-9294-29ff628382c6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:58.762707 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a17cd2-3e88-46ba-9294-29ff628382c6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:58.763240 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a17cd2-3e88-46ba-9294-29ff628382c6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:58.763736 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-84a17cd2-3e88-46ba-9294-29ff628382c6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:59.005297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-84a17cd2-3e88-46ba-9294-29ff628382c6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "POST /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/action" status: 202 len: 0 microversion: 2.1 time: 0.256886 Sep 11 08:51:59.011455 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 313/658] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:51:58 2022] POST /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:51:59.019386 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8025a828-b2b7-49b3-8f2e-28f4c32bb6e1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:59.020119 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8025a828-b2b7-49b3-8f2e-28f4c32bb6e1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:59.028015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8025a828-b2b7-49b3-8f2e-28f4c32bb6e1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:59.028517 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8025a828-b2b7-49b3-8f2e-28f4c32bb6e1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:59.028957 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8025a828-b2b7-49b3-8f2e-28f4c32bb6e1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:59.029915 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8025a828-b2b7-49b3-8f2e-28f4c32bb6e1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:59.030609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8025a828-b2b7-49b3-8f2e-28f4c32bb6e1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:59.031038 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8025a828-b2b7-49b3-8f2e-28f4c32bb6e1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:59.114370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:59.115645 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:59.124272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:59.124766 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:59.127296 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:59.127296 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:59.127647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:59.128158 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:59.176362 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:59.177058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:59.177690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:59.178339 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lazy-loading 'fault' on Instance uuid 223e4b7b-8a6c-4647-aa91-aae73dbeb340 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:51:59.198514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8025a828-b2b7-49b3-8f2e-28f4c32bb6e1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:59.211779 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8025a828-b2b7-49b3-8f2e-28f4c32bb6e1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1724 microversion: 2.1 time: 0.198124 Sep 11 08:51:59.213253 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 346/659] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:59 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:51:59.218433 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-b0b42935-c037-4441-9c7e-e7dda12397d8 req-d1014230-0491-4793-9cb4-69932e7b52d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223e4b7b-8a6c-4647-aa91-aae73dbeb340", "name": "network-vif-deleted", "tag": "a3c9ee62-2858-49c8-b169-41636e1c8bdd"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:51:59.229255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-b0b42935-c037-4441-9c7e-e7dda12397d8 req-d1014230-0491-4793-9cb4-69932e7b52d0 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:59.229742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-b0b42935-c037-4441-9c7e-e7dda12397d8 req-d1014230-0491-4793-9cb4-69932e7b52d0 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:59.230233 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-b0b42935-c037-4441-9c7e-e7dda12397d8 req-d1014230-0491-4793-9cb4-69932e7b52d0 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:59.230633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:59.243748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:59.247131 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:51:59.248431 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a24a6497-815f-4248-ad51-b266016d84bc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1370 microversion: 2.20 time: 0.138483 Sep 11 08:51:59.258858 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 314/660] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:51:59 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1370 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:51:59.259054 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-b0b42935-c037-4441-9c7e-e7dda12397d8 req-d1014230-0491-4793-9cb4-69932e7b52d0 service nova] Creating event network-vif-deleted:a3c9ee62-2858-49c8-b169-41636e1c8bdd for instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 on hv-cinder-85694 Sep 11 08:51:59.263475 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-b0b42935-c037-4441-9c7e-e7dda12397d8 req-d1014230-0491-4793-9cb4-69932e7b52d0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048694 Sep 11 08:51:59.264813 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 347/661] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:51:59.471748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:59.472496 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] [instance: a2520cc9-8413-40ef-9b12-b5914bff16e2] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:51:59.499045 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:59.499545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:59.500030 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:59.500733 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:51:59.501189 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:51:59.501608 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:51:59.517575 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] HTTP exception thrown: Instance a2520cc9-8413-40ef-9b12-b5914bff16e2 could not be found. Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Request method failure captured: Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 HTTP/1.1 Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaDXnUwtjdB3DOliISZA0FysB2Aqk_Mh1mj6HwTTqDqG767KlMzAUamqR-oltORIB0jg9lT2qBM-CboZMjozN0v00BFCXq_L6aw1TSTlVfNfl9vj0U90iLOMXDdljA9-AzeRD3S4iF7vFb9GPLh1QihuGCbtyxtdHkuWS4S4GhK5Te0 Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: b4f426194c8d41bcaee7862c5d04b180 Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-TestMinimumBasicScenario-2038564111 Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:51:59.519227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b4f426194c8d41bcaee7862c5d04b180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b4f426194c8d41bcaee7862c5d04b180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b4f426194c8d41bcaee7862c5d04b180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b4f426194c8d41bcaee7862c5d04b180", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-TestMinimumBasicScenario-2038564111 Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: b4f426194c8d41bcaee7862c5d04b180 Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2038564111 Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-TestMinimumBasicScenario-2038564111-project Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: a0dde6aa81204252b66b6e640b343ac3 Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-TestMinimumBasicScenario-2038564111-project Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance a2520cc9-8413-40ef-9b12-b5914bff16e2 could not be found. Sep 11 08:51:59.520554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'a2520cc9-8413-40ef-9b12-b5914bff16e2'} Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2520cc9-8413-40ef-9b12-b5914bff16e2 could not be found. Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:51:59.521307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2520cc9-8413-40ef-9b12-b5914bff16e2 could not be found. Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2520cc9-8413-40ef-9b12-b5914bff16e2 could not be found. Sep 11 08:51:59.522566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:51:59.523729 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Returning 404 to user: Instance a2520cc9-8413-40ef-9b12-b5914bff16e2 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:51:59.523729 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-44f35bc3-c0ec-4e03-89cb-422d7b32d001 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2" status: 404 len: 111 microversion: 2.1 time: 0.057264 Sep 11 08:51:59.523729 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 315/662] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:51:59 2022] GET /compute/v2.1/servers/a2520cc9-8413-40ef-9b12-b5914bff16e2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:51:59.531859 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-309ec339-e75c-4859-8f7b-14b027f220d4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] Calling method '.version_select at 0x7fb27ebe5670>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:51:59.631771 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-309ec339-e75c-4859-8f7b-14b027f220d4 tempest-TestMinimumBasicScenario-2038564111 tempest-TestMinimumBasicScenario-2038564111-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-437335689" status: 202 len: 0 microversion: 2.1 time: 0.105394 Sep 11 08:51:59.632966 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 348/663] 10.222.0.44 () {58 vars in 1269 bytes} [Sun Sep 11 08:51:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-437335689 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:52:00.241362 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-54c1b1d0-cdfc-4ff0-808d-86d71300e18c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:00.244841 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-54c1b1d0-cdfc-4ff0-808d-86d71300e18c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:00.251096 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54c1b1d0-cdfc-4ff0-808d-86d71300e18c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:00.251978 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54c1b1d0-cdfc-4ff0-808d-86d71300e18c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:00.252669 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54c1b1d0-cdfc-4ff0-808d-86d71300e18c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:00.253632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54c1b1d0-cdfc-4ff0-808d-86d71300e18c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:00.254461 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54c1b1d0-cdfc-4ff0-808d-86d71300e18c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:00.255140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-54c1b1d0-cdfc-4ff0-808d-86d71300e18c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:00.288104 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:00.289616 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:00.304963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:00.306099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:00.306723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:00.307533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:00.308565 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:00.308811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:00.313059 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:00.361360 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:00.361929 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:00.362468 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:00.362930 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lazy-loading 'fault' on Instance uuid 223e4b7b-8a6c-4647-aa91-aae73dbeb340 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:52:00.433496 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:00.443234 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:00.444721 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:00.445905 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-80179cef-a01b-440b-9a68-f529b4bbfeea tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 200 len: 1370 microversion: 2.20 time: 0.171352 Sep 11 08:52:00.446500 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 349/664] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:00 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:00.512113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-54c1b1d0-cdfc-4ff0-808d-86d71300e18c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:00.530831 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-54c1b1d0-cdfc-4ff0-808d-86d71300e18c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1724 microversion: 2.1 time: 0.293738 Sep 11 08:52:00.546680 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 316/665] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:00 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:01.495695 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:01.496325 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:01.503716 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:01.504196 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:01.504624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:01.505309 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:01.505754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:01.506187 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:01.522821 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] HTTP exception thrown: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Request method failure captured: Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 HTTP/1.1 Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaB_C40XblA_5JONLNSEypiACZOwRk90-JlMDAvxxPz8wSyjQX1ubyq6cAPuubBG2EObAAR_SYSnZ4Mw7s3l8yjvf1Iiu3oz6h7lVxnWUGzQHGGGt2w4RVEq7YIZotgEtVZH9_WHhQLP8mHPEUV5Kzc02ErEoDVPUzIS25A0sruBbjA Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:52:01.524494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_018b87eeeda248e4a85f587c31e297f4", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: 64ea6fbc6e7d42dabdf459e8de4c3621 Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:52:01.527516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': '223e4b7b-8a6c-4647-aa91-aae73dbeb340'} Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:52:01.529231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:52:01.534522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:52:01.536910 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Returning 404 to user: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:52:01.536910 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3c80f4c4-b902-4228-b5d2-91aabe40a3c6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 404 len: 111 microversion: 2.20 time: 0.034274 Sep 11 08:52:01.536910 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 350/666] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:01 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 08:52:01.538443 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-fe11a073-b4ab-405d-99d5-77bdc6ed3de1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '.version_select at 0x7fb27ed9a9d0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:01.570570 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e880230b-f56c-4f10-b6d3-8e7e0b7c00ae tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:01.571201 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e880230b-f56c-4f10-b6d3-8e7e0b7c00ae tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:01.578684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e880230b-f56c-4f10-b6d3-8e7e0b7c00ae tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:01.585017 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e880230b-f56c-4f10-b6d3-8e7e0b7c00ae tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:01.585017 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e880230b-f56c-4f10-b6d3-8e7e0b7c00ae tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:01.585017 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e880230b-f56c-4f10-b6d3-8e7e0b7c00ae tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:01.585017 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e880230b-f56c-4f10-b6d3-8e7e0b7c00ae tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:01.585648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e880230b-f56c-4f10-b6d3-8e7e0b7c00ae tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:01.631555 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-fe11a073-b4ab-405d-99d5-77bdc6ed3de1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-492733929" status: 204 len: 0 microversion: 2.20 time: 0.100309 Sep 11 08:52:01.632600 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 317/667] 10.222.0.44 () {60 vars in 1259 bytes} [Sun Sep 11 08:52:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-492733929 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 11 08:52:01.811327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e880230b-f56c-4f10-b6d3-8e7e0b7c00ae tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:01.821956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e880230b-f56c-4f10-b6d3-8e7e0b7c00ae tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1724 microversion: 2.1 time: 0.255660 Sep 11 08:52:01.823612 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 351/668] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:01 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:52:02.731949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6ba4e96e-a769-41d1-b9f9-abdd77ecc9f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Action: 'create', calling method: .version_select at 0x7fb27ed52310>, body: {"keypair": {"name": "tempest-keypair-952627283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVJHeBiYWCT84qcdkriyxQh7M2KiKOpY6vCmriLPsKLEVXsP49gyfjhYXIwvr+7841Mc/kbc5J4SllEtTla3RsBb/jc3wmKVCxbNIx5F8lPPxc1EYLfHvST02W12a06AQ=="}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:02.762880 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-6ba4e96e-a769-41d1-b9f9-abdd77ecc9f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Getting quotas for project 018b87eeeda248e4a85f587c31e297f4. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:52:02.762880 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-6ba4e96e-a769-41d1-b9f9-abdd77ecc9f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Getting quotas for user 64ea6fbc6e7d42dabdf459e8de4c3621 and project 018b87eeeda248e4a85f587c31e297f4. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:52:02.849198 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0baef67c-d2fe-47b9-b5f2-147cfe830209 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:02.849937 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0baef67c-d2fe-47b9-b5f2-147cfe830209 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:02.856691 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0baef67c-d2fe-47b9-b5f2-147cfe830209 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:02.857379 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0baef67c-d2fe-47b9-b5f2-147cfe830209 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:02.857812 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0baef67c-d2fe-47b9-b5f2-147cfe830209 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:02.858555 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0baef67c-d2fe-47b9-b5f2-147cfe830209 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:02.859309 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0baef67c-d2fe-47b9-b5f2-147cfe830209 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:02.859733 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0baef67c-d2fe-47b9-b5f2-147cfe830209 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:02.923461 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6ba4e96e-a769-41d1-b9f9-abdd77ecc9f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.196640 Sep 11 08:52:02.924382 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 318/669] 10.222.0.44 () {62 vars in 1200 bytes} [Sun Sep 11 08:52:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 198 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 11 08:52:03.028729 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0baef67c-d2fe-47b9-b5f2-147cfe830209 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:03.038693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0baef67c-d2fe-47b9-b5f2-147cfe830209 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1730 microversion: 2.1 time: 0.193138 Sep 11 08:52:03.039619 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 352/670] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:02 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:52:03.064721 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-810cda54-74b6-4267-b434-b4fca003cbde tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:03.065742 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-810cda54-74b6-4267-b434-b4fca003cbde tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:03.072722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-810cda54-74b6-4267-b434-b4fca003cbde tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:03.073224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-810cda54-74b6-4267-b434-b4fca003cbde tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:03.073654 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-810cda54-74b6-4267-b434-b4fca003cbde tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:03.074609 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-810cda54-74b6-4267-b434-b4fca003cbde tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:03.075493 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-810cda54-74b6-4267-b434-b4fca003cbde tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:03.076086 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-810cda54-74b6-4267-b434-b4fca003cbde tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:03.222408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-810cda54-74b6-4267-b434-b4fca003cbde tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162342 Sep 11 08:52:03.223563 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 319/671] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 08:52:03 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:52:04.809275 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-d4fd3787-bd22-4291-8e38-9ed711a89da4 req-97e1f9b0-ef6f-407b-99d0-6d3467f9bfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecad74b6-c736-4f92-9339-9fe3221c0700", "tag": "fb0a2c0a-f47e-49a3-a803-c69e51e3ed11"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:04.824495 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d4fd3787-bd22-4291-8e38-9ed711a89da4 req-97e1f9b0-ef6f-407b-99d0-6d3467f9bfa2 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:04.824988 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d4fd3787-bd22-4291-8e38-9ed711a89da4 req-97e1f9b0-ef6f-407b-99d0-6d3467f9bfa2 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:04.825415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d4fd3787-bd22-4291-8e38-9ed711a89da4 req-97e1f9b0-ef6f-407b-99d0-6d3467f9bfa2 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:04.858418 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-d4fd3787-bd22-4291-8e38-9ed711a89da4 req-97e1f9b0-ef6f-407b-99d0-6d3467f9bfa2 service nova] Creating event network-changed:fb0a2c0a-f47e-49a3-a803-c69e51e3ed11 for instance ecad74b6-c736-4f92-9339-9fe3221c0700 on hv-cinder-85694 Sep 11 08:52:04.870399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-d4fd3787-bd22-4291-8e38-9ed711a89da4 req-97e1f9b0-ef6f-407b-99d0-6d3467f9bfa2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062850 Sep 11 08:52:04.873294 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 353/672] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:52:05.103598 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-91eb9cb6-de7b-4c55-a52b-d232324b0900 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:05.105842 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-91eb9cb6-de7b-4c55-a52b-d232324b0900 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:05.115899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-91eb9cb6-de7b-4c55-a52b-d232324b0900 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:05.116391 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-91eb9cb6-de7b-4c55-a52b-d232324b0900 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:05.116821 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-91eb9cb6-de7b-4c55-a52b-d232324b0900 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:05.117521 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-91eb9cb6-de7b-4c55-a52b-d232324b0900 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:05.118015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-91eb9cb6-de7b-4c55-a52b-d232324b0900 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:05.118497 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-91eb9cb6-de7b-4c55-a52b-d232324b0900 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:05.159796 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-91eb9cb6-de7b-4c55-a52b-d232324b0900 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061118 Sep 11 08:52:05.161501 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 320/673] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:52:05 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 08:52:05.278389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-52764e2c-bc86-43c7-b1bd-8547f358ea95 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:05.279967 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-52764e2c-bc86-43c7-b1bd-8547f358ea95 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:05.290910 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52764e2c-bc86-43c7-b1bd-8547f358ea95 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:05.291769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52764e2c-bc86-43c7-b1bd-8547f358ea95 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:05.292583 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52764e2c-bc86-43c7-b1bd-8547f358ea95 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:05.294210 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52764e2c-bc86-43c7-b1bd-8547f358ea95 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:05.296027 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52764e2c-bc86-43c7-b1bd-8547f358ea95 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:05.297392 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52764e2c-bc86-43c7-b1bd-8547f358ea95 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:05.352322 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-52764e2c-bc86-43c7-b1bd-8547f358ea95 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Going to try to terminate instance {{(pid=127646) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:52:05.621232 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-52764e2c-bc86-43c7-b1bd-8547f358ea95 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 204 len: 0 microversion: 2.1 time: 0.349309 Sep 11 08:52:05.621837 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 354/674] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:52:05 2022] DELETE /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:52:05.631065 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-906fbffc-1275-456c-9cb6-fa7c4d48f308 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:05.631916 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-906fbffc-1275-456c-9cb6-fa7c4d48f308 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:05.645175 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-906fbffc-1275-456c-9cb6-fa7c4d48f308 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:05.645175 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-906fbffc-1275-456c-9cb6-fa7c4d48f308 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:05.645598 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-906fbffc-1275-456c-9cb6-fa7c4d48f308 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:05.646352 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-906fbffc-1275-456c-9cb6-fa7c4d48f308 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:05.646821 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-906fbffc-1275-456c-9cb6-fa7c4d48f308 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:05.647255 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-906fbffc-1275-456c-9cb6-fa7c4d48f308 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:05.919033 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-906fbffc-1275-456c-9cb6-fa7c4d48f308 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:05.930554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-906fbffc-1275-456c-9cb6-fa7c4d48f308 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1669 microversion: 2.1 time: 0.303428 Sep 11 08:52:05.948729 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 321/675] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:05 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1669 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:06.556399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-181348098", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5be8985a-737b-46de-bef6-189240965867"}], "security_groups": [{"name": "tempest-securitygroup--94588357"}], "key_name": "tempest-keypair-952627283", "user_data": "}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:06.662521 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] validate_networks() for [('5be8985a-737b-46de-bef6-189240965867', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:52:06.887280 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-b3986eba-cb56-48c2-899a-b50a891e4ff8 req-c0125942-aa8d-4a56-815e-cf620012b953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecad74b6-c736-4f92-9339-9fe3221c0700", "tag": "fb0a2c0a-f47e-49a3-a803-c69e51e3ed11"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:06.897585 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-b3986eba-cb56-48c2-899a-b50a891e4ff8 req-c0125942-aa8d-4a56-815e-cf620012b953 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:06.898073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-b3986eba-cb56-48c2-899a-b50a891e4ff8 req-c0125942-aa8d-4a56-815e-cf620012b953 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:06.898538 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-b3986eba-cb56-48c2-899a-b50a891e4ff8 req-c0125942-aa8d-4a56-815e-cf620012b953 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:06.911510 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-b3986eba-cb56-48c2-899a-b50a891e4ff8 req-c0125942-aa8d-4a56-815e-cf620012b953 service nova] Creating event network-changed:fb0a2c0a-f47e-49a3-a803-c69e51e3ed11 for instance ecad74b6-c736-4f92-9339-9fe3221c0700 on hv-cinder-85694 Sep 11 08:52:06.917719 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-b3986eba-cb56-48c2-899a-b50a891e4ff8 req-c0125942-aa8d-4a56-815e-cf620012b953 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033937 Sep 11 08:52:06.918453 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 322/676] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:52:06.959551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3bdd6d68-9416-4f65-a9b0-d0c40ffbb024 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:06.960684 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3bdd6d68-9416-4f65-a9b0-d0c40ffbb024 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:06.967881 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bdd6d68-9416-4f65-a9b0-d0c40ffbb024 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:06.968348 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bdd6d68-9416-4f65-a9b0-d0c40ffbb024 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:06.969492 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bdd6d68-9416-4f65-a9b0-d0c40ffbb024 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:06.970340 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bdd6d68-9416-4f65-a9b0-d0c40ffbb024 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:06.970873 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bdd6d68-9416-4f65-a9b0-d0c40ffbb024 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:06.971368 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bdd6d68-9416-4f65-a9b0-d0c40ffbb024 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:07.141272 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:52:07.141763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3bdd6d68-9416-4f65-a9b0-d0c40ffbb024 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:07.142020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:52:07.142928 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:52:07.143666 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:52:07.144397 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:52:07.150068 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3bdd6d68-9416-4f65-a9b0-d0c40ffbb024 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1669 microversion: 2.1 time: 0.195112 Sep 11 08:52:07.150691 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 323/677] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:06 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1669 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:52:07.170047 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:07.170689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:07.171188 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:07.172423 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:07.172562 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:07.173049 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:07.184880 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:07.205831 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Getting quotas for project 018b87eeeda248e4a85f587c31e297f4. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:52:07.212804 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Getting quotas for user 64ea6fbc6e7d42dabdf459e8de4c3621 and project 018b87eeeda248e4a85f587c31e297f4. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:52:07.226115 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:52:07.229011 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:52:07.363215 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2002b13a-79f4-4af5-aa72-289ca4a4c91e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.811965 Sep 11 08:52:07.364344 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 355/678] 10.222.0.44 () {62 vars in 1188 bytes} [Sun Sep 11 08:52:06 2022] POST /compute/v2.1/servers => generated 400 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 11 08:52:07.381915 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6e407045-e39e-4493-983c-7aef69f4cdae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:07.384157 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6e407045-e39e-4493-983c-7aef69f4cdae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:07.449660 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6e407045-e39e-4493-983c-7aef69f4cdae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:07.459607 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6e407045-e39e-4493-983c-7aef69f4cdae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:07.461736 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6e407045-e39e-4493-983c-7aef69f4cdae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:07.462942 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6e407045-e39e-4493-983c-7aef69f4cdae tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1280 microversion: 2.20 time: 0.088715 Sep 11 08:52:07.463687 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 324/679] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:07 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:08.184458 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e8544a56-4797-4553-8b3f-941eb8384b8c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:08.185586 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e8544a56-4797-4553-8b3f-941eb8384b8c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:08.199721 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e8544a56-4797-4553-8b3f-941eb8384b8c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:08.200584 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e8544a56-4797-4553-8b3f-941eb8384b8c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:08.201349 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e8544a56-4797-4553-8b3f-941eb8384b8c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:08.202644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e8544a56-4797-4553-8b3f-941eb8384b8c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:08.204036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e8544a56-4797-4553-8b3f-941eb8384b8c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:08.204810 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e8544a56-4797-4553-8b3f-941eb8384b8c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:08.498560 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1dd86fcf-f42f-45d4-9848-bbe66e5089d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:08.500158 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1dd86fcf-f42f-45d4-9848-bbe66e5089d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:08.567341 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e8544a56-4797-4553-8b3f-941eb8384b8c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:08.578464 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e8544a56-4797-4553-8b3f-941eb8384b8c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1669 microversion: 2.1 time: 0.404718 Sep 11 08:52:08.581912 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 356/680] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:08 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1669 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:08.598332 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1dd86fcf-f42f-45d4-9848-bbe66e5089d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:08.608417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1dd86fcf-f42f-45d4-9848-bbe66e5089d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:08.610933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1dd86fcf-f42f-45d4-9848-bbe66e5089d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:08.612575 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1dd86fcf-f42f-45d4-9848-bbe66e5089d5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1280 microversion: 2.20 time: 0.118701 Sep 11 08:52:08.613198 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 325/681] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:08 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1280 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:52:09.265980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c8ef3d73-6aec-45b3-954d-f5eb492fe809 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cc9ffca-100b-4992-b8ea-bed0e3239ec3", "device": "/dev/sdb"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:09.272886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c8ef3d73-6aec-45b3-954d-f5eb492fe809 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:09.282386 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ef3d73-6aec-45b3-954d-f5eb492fe809 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:09.283171 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ef3d73-6aec-45b3-954d-f5eb492fe809 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:09.283974 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ef3d73-6aec-45b3-954d-f5eb492fe809 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:09.285319 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ef3d73-6aec-45b3-954d-f5eb492fe809 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:09.286376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ef3d73-6aec-45b3-954d-f5eb492fe809 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:09.287089 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ef3d73-6aec-45b3-954d-f5eb492fe809 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:09.603496 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-94b7ae98-7e85-4672-a299-b692df21fba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:09.604705 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-94b7ae98-7e85-4672-a299-b692df21fba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:09.615383 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-94b7ae98-7e85-4672-a299-b692df21fba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:09.615863 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-94b7ae98-7e85-4672-a299-b692df21fba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:09.616440 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-94b7ae98-7e85-4672-a299-b692df21fba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:09.617765 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-94b7ae98-7e85-4672-a299-b692df21fba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:09.618530 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-94b7ae98-7e85-4672-a299-b692df21fba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:09.619208 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-94b7ae98-7e85-4672-a299-b692df21fba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:09.846777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-94b7ae98-7e85-4672-a299-b692df21fba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:09.865977 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-94b7ae98-7e85-4672-a299-b692df21fba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1604 microversion: 2.1 time: 0.265635 Sep 11 08:52:09.895737 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 326/682] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:09 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:09.903071 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:09.903955 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:09.913025 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:09.913915 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:09.915019 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:09.917888 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:09.924346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:09.925321 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:10.088257 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:10.143635 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:10.145263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:10.146680 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-416ec607-8898-42e4-995b-0f1c9ea366c0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1332 microversion: 2.20 time: 0.249092 Sep 11 08:52:10.147761 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 327/683] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:09 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1332 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:10.318030 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c8ef3d73-6aec-45b3-954d-f5eb492fe809 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "POST /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.056958 Sep 11 08:52:10.319288 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 357/684] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:52:09 2022] POST /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728/os-volume_attachments => generated 194 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:52:10.329816 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-7272be4c-fd01-4326-b035-df213fd853b4 req-07509513-d398-4d2d-8484-52979b220bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1185ff5c-f369-4602-8e3e-c4a1438ed06e", "name": "network-vif-deleted", "tag": "90d591de-aca3-45c6-b43c-b9d5b5525d09"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:10.343915 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-7272be4c-fd01-4326-b035-df213fd853b4 req-07509513-d398-4d2d-8484-52979b220bb3 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:10.345327 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-7272be4c-fd01-4326-b035-df213fd853b4 req-07509513-d398-4d2d-8484-52979b220bb3 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:10.346104 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-7272be4c-fd01-4326-b035-df213fd853b4 req-07509513-d398-4d2d-8484-52979b220bb3 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:10.381534 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-7272be4c-fd01-4326-b035-df213fd853b4 req-07509513-d398-4d2d-8484-52979b220bb3 service nova] Creating event network-vif-deleted:90d591de-aca3-45c6-b43c-b9d5b5525d09 for instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e on hv-cinder-85694 Sep 11 08:52:10.394256 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-7272be4c-fd01-4326-b035-df213fd853b4 req-07509513-d398-4d2d-8484-52979b220bb3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068381 Sep 11 08:52:10.399910 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 328/685] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:52:10.895531 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:10.896241 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:10.905148 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:10.906744 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:10.908111 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:10.909000 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:10.909657 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:10.910412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:10.949574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:10.950405 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:10.951015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:10.951658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'fault' on Instance uuid 1185ff5c-f369-4602-8e3e-c4a1438ed06e {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:52:10.959447 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:11.203836 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:11.210107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:11.235315 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:11.236981 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:11.238422 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:11.240441 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:11.253413 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:11.257424 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:11.405293 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:11.407723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:11.419195 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-eaf39d10-5206-47eb-bd87-be32b5d55046 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 200 len: 1326 microversion: 2.1 time: 0.528842 Sep 11 08:52:11.420531 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 358/686] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:10 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 1326 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:11.421635 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:11.423916 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:11.425692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d9208456-ccd8-42cc-b9b4-0bdc95651986 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1350 microversion: 2.20 time: 0.250890 Sep 11 08:52:11.431276 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 329/687] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:11 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1350 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:12.455743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:12.456519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:12.461103 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:12.461738 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:12.465978 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:12.466632 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:12.467134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:12.467910 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:12.468226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:12.470986 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:12.471106 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:12.471203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:12.471294 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:12.471294 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:12.471294 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:12.471543 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:12.486312 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] HTTP exception thrown: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Request method failure captured: Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e HTTP/1.1 Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaCEKxQm61HhkD1G3VxeGvmkxppEfvGwRWCWczWYviKu-xMPL-RWpAs1sdqFMUBuh3nY7ReczgkWXrER6Ser28oDMWdBqSdmTpLlv2Iw4VpNvzd4yIZUDciIF8qw5Nvj5sh0cILYkRc-i81PpJ0oxdkEg2C145MTYYO-_myVoUnRik4 Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:52:12.487990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/347504c603af4937b829f24349b013c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_347504c603af4937b829f24349b013c2", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 3abba619decf448db477533c663004bb Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:52:12.489410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': '1185ff5c-f369-4602-8e3e-c4a1438ed06e'} Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:52:12.490176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:52:12.491885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:12.494637 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Returning 404 to user: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:52:12.494637 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-509fed39-4fb3-46e6-8461-0bfc2cddef22 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 404 len: 111 microversion: 2.1 time: 0.033305 Sep 11 08:52:12.494637 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 330/688] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:12 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 08:52:12.498530 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-05d4e79d-b787-4ffd-b42a-ee7fafd37ca0 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '.version_select at 0x7fb27ec293a0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:12.541770 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:12.550397 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:12.552212 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:12.553866 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c908a29f-8384-4a09-a32c-61e2f1bcfdfb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1338 microversion: 2.20 time: 0.102519 Sep 11 08:52:12.554490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 359/689] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:12 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:12.629775 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-05d4e79d-b787-4ffd-b42a-ee7fafd37ca0 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176508027" status: 202 len: 0 microversion: 2.1 time: 0.132824 Sep 11 08:52:12.633046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 331/690] 10.222.0.44 () {58 vars in 1218 bytes} [Sun Sep 11 08:52:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176508027 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:52:13.542502 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d2d67af1-a39e-40c5-9ead-db53193ebd62 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Action: 'create', calling method: .version_select at 0x7fb27eb45280>, body: {"keypair": {"name": "tempest-keypair-1469132432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBzQLMPoX/so3EtBiYWWoQM1iNL6jCK1Rvz4uS3pK0UwaR9YaUqm9P5ittrG3Zz+bke0p1U5s9+LWKbkgKBmtyo2ftmvGvhJ4uSeBPR6J6vqy+qwDJRhfkzLc0gSoT0Jw=="}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:13.561666 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-d2d67af1-a39e-40c5-9ead-db53193ebd62 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Getting quotas for project 347504c603af4937b829f24349b013c2. Resources: {'key_pairs'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:52:13.566023 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-d2d67af1-a39e-40c5-9ead-db53193ebd62 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Getting quotas for user 3abba619decf448db477533c663004bb and project 347504c603af4937b829f24349b013c2. Resources: {'key_pairs'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:52:13.583552 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:13.584309 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:13.592658 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:13.593804 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:13.594554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:13.595546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:13.596075 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:13.596546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:13.672430 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d2d67af1-a39e-40c5-9ead-db53193ebd62 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133151 Sep 11 08:52:13.673070 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 360/691] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 08:52:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:52:13.788588 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:13.799310 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:13.801212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:13.806962 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-7b9266e2-b2c2-4687-9456-656080f9a80d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1404 microversion: 2.20 time: 0.224843 Sep 11 08:52:13.806962 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 332/692] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:13 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1404 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:52:14.074726 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-58d2832a-2456-47bd-b63d-3192594cc7dc req-9e4d5c35-a969-4c6b-bdb1-e660a4b1b601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe", "tag": "2a26af6d-2714-450a-b99a-6e72dec54d7e"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:14.086467 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-58d2832a-2456-47bd-b63d-3192594cc7dc req-9e4d5c35-a969-4c6b-bdb1-e660a4b1b601 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:14.087191 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-58d2832a-2456-47bd-b63d-3192594cc7dc req-9e4d5c35-a969-4c6b-bdb1-e660a4b1b601 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:14.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-58d2832a-2456-47bd-b63d-3192594cc7dc req-9e4d5c35-a969-4c6b-bdb1-e660a4b1b601 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:14.100020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-58d2832a-2456-47bd-b63d-3192594cc7dc req-9e4d5c35-a969-4c6b-bdb1-e660a4b1b601 service nova] Creating event network-changed:2a26af6d-2714-450a-b99a-6e72dec54d7e for instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe on hv-cinder-85694 Sep 11 08:52:14.105206 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-58d2832a-2456-47bd-b63d-3192594cc7dc req-9e4d5c35-a969-4c6b-bdb1-e660a4b1b601 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034217 Sep 11 08:52:14.106414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 361/693] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:52:14.829097 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:14.829715 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:14.836277 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:14.836770 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:14.837213 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:14.837916 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:14.838398 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:14.838872 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:15.019435 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:15.027978 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:15.029411 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:15.030550 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2c56d068-3198-41b3-af8f-d9f867b1635f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1404 microversion: 2.20 time: 0.205482 Sep 11 08:52:15.031098 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 333/694] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:14 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1404 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:16.056528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:16.062849 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:16.071215 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:16.071840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:16.072155 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:16.072859 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:16.074532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:16.074532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:16.220724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:16.229091 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:16.230628 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:16.231799 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-62575453-2118-4ae2-a6f4-574d4613885c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1404 microversion: 2.20 time: 0.179875 Sep 11 08:52:16.232396 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 362/695] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:16 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1404 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:16.243095 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-509801243", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0fe0fa1a-815d-4049-afc0-259e74885d31"}], "security_groups": [{"name": "tempest-securitygroup--1209861148"}], "key_name": "tempest-keypair-1469132432", "user_data": "}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:16.350420 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.network.neutron [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] validate_networks() for [('0fe0fa1a-815d-4049-afc0-259e74885d31', None, None, None, None, None)] {{(pid=127647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:52:16.817144 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Flavor limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:52:16.817570 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Image limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:52:16.818053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Flavor pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:52:16.818523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Image pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:52:16.818939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:52:16.827899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:16.828388 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:16.828829 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:16.829561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:16.830014 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:16.830482 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:16.847639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Getting quotas for project 347504c603af4937b829f24349b013c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:52:16.849074 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:16.852607 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Getting quotas for user 3abba619decf448db477533c663004bb and project 347504c603af4937b829f24349b013c2. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:52:16.865351 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Going to run 1 instances... {{(pid=127647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:52:16.867741 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:52:17.029620 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-7b3235c6-b0b3-46ba-90b1-d8b6eafdaeb6 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.791076 Sep 11 08:52:17.030295 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 334/696] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:52:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:52:17.042080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7e9499e7-0fa4-4ed8-823e-2b58bae45d68 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:17.042720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7e9499e7-0fa4-4ed8-823e-2b58bae45d68 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:17.101768 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7e9499e7-0fa4-4ed8-823e-2b58bae45d68 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:17.109738 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7e9499e7-0fa4-4ed8-823e-2b58bae45d68 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1237 microversion: 2.1 time: 0.070493 Sep 11 08:52:17.110673 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 363/697] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:17 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:17.257038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:17.257647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:17.267734 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:17.268224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:17.268661 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:17.269368 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:17.269828 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:17.270373 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:17.419977 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:17.428845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:17.430344 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:17.431518 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-09eb0088-8b15-40f2-add9-a6f5dff5b5ef tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1404 microversion: 2.20 time: 0.178498 Sep 11 08:52:17.432276 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 335/698] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:17 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1404 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:18.135794 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3be58140-2479-4f82-b3dc-7e3a9d7580bc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:18.136657 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3be58140-2479-4f82-b3dc-7e3a9d7580bc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:18.140873 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:18.148305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3be58140-2479-4f82-b3dc-7e3a9d7580bc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:18.148796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3be58140-2479-4f82-b3dc-7e3a9d7580bc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:18.149411 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3be58140-2479-4f82-b3dc-7e3a9d7580bc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:18.150337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3be58140-2479-4f82-b3dc-7e3a9d7580bc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:18.150980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3be58140-2479-4f82-b3dc-7e3a9d7580bc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:18.151584 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3be58140-2479-4f82-b3dc-7e3a9d7580bc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:18.252261 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3be58140-2479-4f82-b3dc-7e3a9d7580bc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:18.263480 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3be58140-2479-4f82-b3dc-7e3a9d7580bc tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1241 microversion: 2.1 time: 0.131469 Sep 11 08:52:18.264143 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 364/699] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:18 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:52:18.463472 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:18.464335 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:18.472891 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:18.473385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:18.473827 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:18.474593 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:18.475054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:18.475489 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:18.636566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:18.644844 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:18.646323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:18.647472 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-595ba40e-ecc4-48d9-9b6b-3958002f8237 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1404 microversion: 2.20 time: 0.188072 Sep 11 08:52:18.648036 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 336/700] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:18 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1404 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:19.294960 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4da50934-5091-4b77-9e93-21fde59a2322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:19.295466 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4da50934-5091-4b77-9e93-21fde59a2322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:19.303087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4da50934-5091-4b77-9e93-21fde59a2322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:19.303539 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4da50934-5091-4b77-9e93-21fde59a2322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:19.304040 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4da50934-5091-4b77-9e93-21fde59a2322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:19.304751 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4da50934-5091-4b77-9e93-21fde59a2322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:19.305210 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4da50934-5091-4b77-9e93-21fde59a2322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:19.305640 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4da50934-5091-4b77-9e93-21fde59a2322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:19.379188 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4da50934-5091-4b77-9e93-21fde59a2322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:19.390607 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4da50934-5091-4b77-9e93-21fde59a2322 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1289 microversion: 2.1 time: 0.100199 Sep 11 08:52:19.391308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 365/701] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:19 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:19.675182 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:19.676208 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:19.684369 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:19.685148 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:19.685666 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:19.686634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:19.688210 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:19.688824 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:19.774619 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-7f7f588c-3609-44fd-883b-6cb415fe5748 req-85f1d5ca-12a0-455b-b5d7-e76737c4403c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe", "name": "network-vif-plugged", "status": "completed", "tag": "2a26af6d-2714-450a-b99a-6e72dec54d7e"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:19.789340 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-7f7f588c-3609-44fd-883b-6cb415fe5748 req-85f1d5ca-12a0-455b-b5d7-e76737c4403c service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:19.789909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-7f7f588c-3609-44fd-883b-6cb415fe5748 req-85f1d5ca-12a0-455b-b5d7-e76737c4403c service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:19.790368 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-7f7f588c-3609-44fd-883b-6cb415fe5748 req-85f1d5ca-12a0-455b-b5d7-e76737c4403c service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:19.801934 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-7f7f588c-3609-44fd-883b-6cb415fe5748 req-85f1d5ca-12a0-455b-b5d7-e76737c4403c service nova] Creating event network-vif-plugged:2a26af6d-2714-450a-b99a-6e72dec54d7e for instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe on hv-cinder-85694 Sep 11 08:52:19.808984 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-7f7f588c-3609-44fd-883b-6cb415fe5748 req-85f1d5ca-12a0-455b-b5d7-e76737c4403c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038323 Sep 11 08:52:19.809990 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 366/702] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:52:19.841350 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:19.850955 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:19.852532 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:19.854096 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-146d9a4e-c52e-4aa0-8270-3167cfde8313 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1404 microversion: 2.20 time: 0.184617 Sep 11 08:52:19.859190 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 337/703] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:19 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1404 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:20.420568 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-095a41a5-436a-43e5-ba51-b82f5dc8f376 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:20.421873 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-095a41a5-436a-43e5-ba51-b82f5dc8f376 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:20.428362 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095a41a5-436a-43e5-ba51-b82f5dc8f376 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:20.428874 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095a41a5-436a-43e5-ba51-b82f5dc8f376 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:20.429310 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095a41a5-436a-43e5-ba51-b82f5dc8f376 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:20.430012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095a41a5-436a-43e5-ba51-b82f5dc8f376 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:20.430496 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095a41a5-436a-43e5-ba51-b82f5dc8f376 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:20.430921 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095a41a5-436a-43e5-ba51-b82f5dc8f376 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:20.498424 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-095a41a5-436a-43e5-ba51-b82f5dc8f376 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:20.507075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-095a41a5-436a-43e5-ba51-b82f5dc8f376 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1307 microversion: 2.1 time: 0.091233 Sep 11 08:52:20.507658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 367/704] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:20 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:20.881690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:20.882334 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:20.890613 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:20.891409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:20.892085 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:20.893150 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:20.893839 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:20.894516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:21.038847 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:21.047580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:21.049065 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:21.050112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-581285b4-380d-4275-af4b-7a9a64c7d408 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1404 microversion: 2.20 time: 0.173208 Sep 11 08:52:21.050702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 338/705] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:20 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:21.531352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b82b5591-41a7-450a-a8a1-439a7983c26e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:21.531979 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b82b5591-41a7-450a-a8a1-439a7983c26e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:21.539148 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b82b5591-41a7-450a-a8a1-439a7983c26e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:21.539639 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b82b5591-41a7-450a-a8a1-439a7983c26e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:21.540074 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b82b5591-41a7-450a-a8a1-439a7983c26e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:21.540788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b82b5591-41a7-450a-a8a1-439a7983c26e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:21.541247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b82b5591-41a7-450a-a8a1-439a7983c26e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:21.541671 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b82b5591-41a7-450a-a8a1-439a7983c26e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:21.617473 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b82b5591-41a7-450a-a8a1-439a7983c26e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:21.626254 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b82b5591-41a7-450a-a8a1-439a7983c26e tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1307 microversion: 2.1 time: 0.099295 Sep 11 08:52:21.626779 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 368/706] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:21 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:22.075793 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:22.076409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:22.083505 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:22.083990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:22.084419 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:22.085121 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:22.085561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:22.085979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:22.218439 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:22.226357 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:22.227787 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:22.228881 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-779b988a-559e-428d-8ecf-3e8c2ce39fbf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1404 microversion: 2.20 time: 0.157195 Sep 11 08:52:22.229474 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 339/707] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:22 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:22.648952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4ca64e73-2b1e-445c-8ecb-9c54ea7296a3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:22.649476 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4ca64e73-2b1e-445c-8ecb-9c54ea7296a3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:22.655873 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ca64e73-2b1e-445c-8ecb-9c54ea7296a3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:22.656362 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ca64e73-2b1e-445c-8ecb-9c54ea7296a3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:22.656803 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ca64e73-2b1e-445c-8ecb-9c54ea7296a3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:22.657501 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ca64e73-2b1e-445c-8ecb-9c54ea7296a3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:22.657951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ca64e73-2b1e-445c-8ecb-9c54ea7296a3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:22.658400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4ca64e73-2b1e-445c-8ecb-9c54ea7296a3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:22.780429 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4ca64e73-2b1e-445c-8ecb-9c54ea7296a3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:22.791425 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4ca64e73-2b1e-445c-8ecb-9c54ea7296a3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1307 microversion: 2.1 time: 0.146294 Sep 11 08:52:22.792030 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 369/708] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:22 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1307 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:23.253834 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:23.254489 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:23.260637 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:23.261120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:23.261551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:23.262289 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:23.262739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:23.263160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:23.403184 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:23.418592 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:23.420140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:23.421955 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-32cbf2cc-edfe-4d2c-922f-dc3696a9bd2c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1404 microversion: 2.20 time: 0.171712 Sep 11 08:52:23.422762 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 340/709] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:23 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:52:23.815282 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-06ae07a9-6a1c-4edf-916b-ae82f98c13b9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:23.815947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-06ae07a9-6a1c-4edf-916b-ae82f98c13b9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:23.822948 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-06ae07a9-6a1c-4edf-916b-ae82f98c13b9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:23.823601 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-06ae07a9-6a1c-4edf-916b-ae82f98c13b9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:23.824208 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-06ae07a9-6a1c-4edf-916b-ae82f98c13b9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:23.824918 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-06ae07a9-6a1c-4edf-916b-ae82f98c13b9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:23.825383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-06ae07a9-6a1c-4edf-916b-ae82f98c13b9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:23.825811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-06ae07a9-6a1c-4edf-916b-ae82f98c13b9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:24.076133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-06ae07a9-6a1c-4edf-916b-ae82f98c13b9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:24.084194 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-06ae07a9-6a1c-4edf-916b-ae82f98c13b9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.273693 Sep 11 08:52:24.085148 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 370/710] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:23 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:24.448030 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:24.448645 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:24.455539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:24.458346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:24.458346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:24.458346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:24.458346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:24.458699 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:24.462062 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=100 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:24.616357 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:24.625432 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:24.626916 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:24.628130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c6d3e7c8-3db7-4529-8b67-3ce6f38f8de0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1596 microversion: 2.20 time: 0.184195 Sep 11 08:52:24.628697 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 341/711] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:52:24 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1596 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:52:24.653104 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0943c180-ee78-4082-b3e2-36235a465f48 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:24.653603 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0943c180-ee78-4082-b3e2-36235a465f48 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:24.659612 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0943c180-ee78-4082-b3e2-36235a465f48 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:24.660099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0943c180-ee78-4082-b3e2-36235a465f48 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:24.660538 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0943c180-ee78-4082-b3e2-36235a465f48 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:24.661223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0943c180-ee78-4082-b3e2-36235a465f48 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:24.661683 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0943c180-ee78-4082-b3e2-36235a465f48 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:24.662105 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0943c180-ee78-4082-b3e2-36235a465f48 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:24.773578 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0943c180-ee78-4082-b3e2-36235a465f48 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.124394 Sep 11 08:52:24.774203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 371/712] 10.222.0.44 () {60 vars in 1316 bytes} [Sun Sep 11 08:52:24 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:52:24.878485 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-95c90c80-6654-45f1-bbf0-57adf3e4f0e5 req-421e5092-c0c2-48a3-8329-3ace98038aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60e297f-d22d-4463-b9ed-d14b988add11", "tag": "d991a1cd-4fdf-4ff9-a1ce-1dea58bcca53"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:24.888079 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-95c90c80-6654-45f1-bbf0-57adf3e4f0e5 req-421e5092-c0c2-48a3-8329-3ace98038aa8 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:24.888562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-95c90c80-6654-45f1-bbf0-57adf3e4f0e5 req-421e5092-c0c2-48a3-8329-3ace98038aa8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:24.888991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-95c90c80-6654-45f1-bbf0-57adf3e4f0e5 req-421e5092-c0c2-48a3-8329-3ace98038aa8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:24.900722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-95c90c80-6654-45f1-bbf0-57adf3e4f0e5 req-421e5092-c0c2-48a3-8329-3ace98038aa8 service nova] Creating event network-changed:d991a1cd-4fdf-4ff9-a1ce-1dea58bcca53 for instance d60e297f-d22d-4463-b9ed-d14b988add11 on hv-cinder-85694 Sep 11 08:52:24.905865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-95c90c80-6654-45f1-bbf0-57adf3e4f0e5 req-421e5092-c0c2-48a3-8329-3ace98038aa8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173950 Sep 11 08:52:24.906523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 342/713] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:52:25.107656 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-31b92249-094d-47c0-a0f4-6b05433e98a2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:25.109174 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-31b92249-094d-47c0-a0f4-6b05433e98a2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:25.115936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b92249-094d-47c0-a0f4-6b05433e98a2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:25.116526 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b92249-094d-47c0-a0f4-6b05433e98a2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:25.116963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b92249-094d-47c0-a0f4-6b05433e98a2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:25.117661 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b92249-094d-47c0-a0f4-6b05433e98a2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:25.118114 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b92249-094d-47c0-a0f4-6b05433e98a2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:25.118561 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b92249-094d-47c0-a0f4-6b05433e98a2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:25.264311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-31b92249-094d-47c0-a0f4-6b05433e98a2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:25.272510 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-31b92249-094d-47c0-a0f4-6b05433e98a2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.168586 Sep 11 08:52:25.273287 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 372/714] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:25 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:25.790526 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-565f155f-904a-4444-8bc2-f0d8a3f73f82 req-8c671ea7-c70e-4c04-9a38-05f6462cb9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe", "tag": "2a26af6d-2714-450a-b99a-6e72dec54d7e"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:25.800581 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-565f155f-904a-4444-8bc2-f0d8a3f73f82 req-8c671ea7-c70e-4c04-9a38-05f6462cb9f8 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:25.801064 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-565f155f-904a-4444-8bc2-f0d8a3f73f82 req-8c671ea7-c70e-4c04-9a38-05f6462cb9f8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:25.801497 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-565f155f-904a-4444-8bc2-f0d8a3f73f82 req-8c671ea7-c70e-4c04-9a38-05f6462cb9f8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:25.814244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-565f155f-904a-4444-8bc2-f0d8a3f73f82 req-8c671ea7-c70e-4c04-9a38-05f6462cb9f8 service nova] Creating event network-changed:2a26af6d-2714-450a-b99a-6e72dec54d7e for instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe on hv-cinder-85694 Sep 11 08:52:25.819570 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-565f155f-904a-4444-8bc2-f0d8a3f73f82 req-8c671ea7-c70e-4c04-9a38-05f6462cb9f8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033528 Sep 11 08:52:25.822669 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 343/715] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:52:26.296281 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9fb5ce63-6830-41ae-9d6e-f204560f9ba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:26.296904 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9fb5ce63-6830-41ae-9d6e-f204560f9ba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:26.307487 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb5ce63-6830-41ae-9d6e-f204560f9ba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:26.308542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb5ce63-6830-41ae-9d6e-f204560f9ba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:26.309499 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb5ce63-6830-41ae-9d6e-f204560f9ba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:26.310881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb5ce63-6830-41ae-9d6e-f204560f9ba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:26.312226 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb5ce63-6830-41ae-9d6e-f204560f9ba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:26.313006 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9fb5ce63-6830-41ae-9d6e-f204560f9ba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:26.486965 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9fb5ce63-6830-41ae-9d6e-f204560f9ba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:26.506542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9fb5ce63-6830-41ae-9d6e-f204560f9ba4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.210120 Sep 11 08:52:26.506542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 373/716] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:26 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:52:27.539276 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:27.540113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=14 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:27.544673 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-34553b6b-143d-4db5-b3c2-6ebb5d470b5f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:27.545409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-34553b6b-143d-4db5-b3c2-6ebb5d470b5f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:27.552726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34553b6b-143d-4db5-b3c2-6ebb5d470b5f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:27.553229 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34553b6b-143d-4db5-b3c2-6ebb5d470b5f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:27.553670 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34553b6b-143d-4db5-b3c2-6ebb5d470b5f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:27.554477 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34553b6b-143d-4db5-b3c2-6ebb5d470b5f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:27.554941 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34553b6b-143d-4db5-b3c2-6ebb5d470b5f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:27.555368 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34553b6b-143d-4db5-b3c2-6ebb5d470b5f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:27.705224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-34553b6b-143d-4db5-b3c2-6ebb5d470b5f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:27.714141 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-34553b6b-143d-4db5-b3c2-6ebb5d470b5f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.176289 Sep 11 08:52:27.715576 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 344/717] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:27 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:28.741936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b7c727ef-7afa-40e3-8d60-384ad5baaa7c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:28.743101 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b7c727ef-7afa-40e3-8d60-384ad5baaa7c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:28.748685 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=12 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:28.756851 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b7c727ef-7afa-40e3-8d60-384ad5baaa7c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:28.757734 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b7c727ef-7afa-40e3-8d60-384ad5baaa7c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:28.758547 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b7c727ef-7afa-40e3-8d60-384ad5baaa7c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:28.759892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b7c727ef-7afa-40e3-8d60-384ad5baaa7c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:28.760689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b7c727ef-7afa-40e3-8d60-384ad5baaa7c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:28.761628 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b7c727ef-7afa-40e3-8d60-384ad5baaa7c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:29.022670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b7c727ef-7afa-40e3-8d60-384ad5baaa7c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:29.030862 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b7c727ef-7afa-40e3-8d60-384ad5baaa7c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.295890 Sep 11 08:52:29.031457 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 374/718] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:28 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:30.059976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a9f65985-ba57-4b57-af36-769f44435cab tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:30.061029 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a9f65985-ba57-4b57-af36-769f44435cab tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:30.071973 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9f65985-ba57-4b57-af36-769f44435cab tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:30.076025 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9f65985-ba57-4b57-af36-769f44435cab tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:30.076025 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9f65985-ba57-4b57-af36-769f44435cab tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:30.076025 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9f65985-ba57-4b57-af36-769f44435cab tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:30.076025 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9f65985-ba57-4b57-af36-769f44435cab tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:30.076527 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a9f65985-ba57-4b57-af36-769f44435cab tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:30.253638 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a9f65985-ba57-4b57-af36-769f44435cab tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:30.261133 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a9f65985-ba57-4b57-af36-769f44435cab tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.207951 Sep 11 08:52:30.261782 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 345/719] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:30 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:52:31.287078 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f1e2bc23-6420-431c-ae66-651bf27263e2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:31.287841 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f1e2bc23-6420-431c-ae66-651bf27263e2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:31.301925 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f1e2bc23-6420-431c-ae66-651bf27263e2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:31.302446 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f1e2bc23-6420-431c-ae66-651bf27263e2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:31.302888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f1e2bc23-6420-431c-ae66-651bf27263e2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:31.303720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f1e2bc23-6420-431c-ae66-651bf27263e2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:31.304157 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f1e2bc23-6420-431c-ae66-651bf27263e2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:31.304574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f1e2bc23-6420-431c-ae66-651bf27263e2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:31.472608 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f1e2bc23-6420-431c-ae66-651bf27263e2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:31.480816 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f1e2bc23-6420-431c-ae66-651bf27263e2 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.197871 Sep 11 08:52:31.481408 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 375/720] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:31 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:32.505873 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7f267783-f0bb-4291-9a90-095d8d013253 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:32.506611 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-7f267783-f0bb-4291-9a90-095d8d013253 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:32.513913 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7f267783-f0bb-4291-9a90-095d8d013253 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:32.514967 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7f267783-f0bb-4291-9a90-095d8d013253 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:32.515413 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7f267783-f0bb-4291-9a90-095d8d013253 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:32.516162 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7f267783-f0bb-4291-9a90-095d8d013253 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:32.516639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7f267783-f0bb-4291-9a90-095d8d013253 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:32.517072 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7f267783-f0bb-4291-9a90-095d8d013253 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:32.681004 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7f267783-f0bb-4291-9a90-095d8d013253 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:32.689469 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-7f267783-f0bb-4291-9a90-095d8d013253 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.187846 Sep 11 08:52:32.690089 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 346/721] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:32 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:52:33.724774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7cb2d883-a001-4390-b3c9-939cffb3ffef tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:33.725427 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7cb2d883-a001-4390-b3c9-939cffb3ffef tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:33.732447 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cb2d883-a001-4390-b3c9-939cffb3ffef tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:33.733030 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cb2d883-a001-4390-b3c9-939cffb3ffef tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:33.734275 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cb2d883-a001-4390-b3c9-939cffb3ffef tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:33.735137 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cb2d883-a001-4390-b3c9-939cffb3ffef tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:33.735590 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cb2d883-a001-4390-b3c9-939cffb3ffef tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:33.736012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cb2d883-a001-4390-b3c9-939cffb3ffef tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:33.903372 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7cb2d883-a001-4390-b3c9-939cffb3ffef tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:33.912535 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7cb2d883-a001-4390-b3c9-939cffb3ffef tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.191782 Sep 11 08:52:33.913154 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 376/722] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:33 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:34.936807 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ca791025-e808-4b4d-adb3-f336d2c425a7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:34.937644 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ca791025-e808-4b4d-adb3-f336d2c425a7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:34.944428 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca791025-e808-4b4d-adb3-f336d2c425a7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:34.944926 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca791025-e808-4b4d-adb3-f336d2c425a7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:34.945369 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca791025-e808-4b4d-adb3-f336d2c425a7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:34.946096 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca791025-e808-4b4d-adb3-f336d2c425a7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:34.946590 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca791025-e808-4b4d-adb3-f336d2c425a7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:34.947014 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca791025-e808-4b4d-adb3-f336d2c425a7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:35.105493 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ca791025-e808-4b4d-adb3-f336d2c425a7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:35.115859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ca791025-e808-4b4d-adb3-f336d2c425a7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.182315 Sep 11 08:52:35.115859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 347/723] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:34 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:36.138925 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-27db2673-4c89-4952-9c11-9ababe13768b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:36.140111 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-27db2673-4c89-4952-9c11-9ababe13768b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:36.149747 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27db2673-4c89-4952-9c11-9ababe13768b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:36.150383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27db2673-4c89-4952-9c11-9ababe13768b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:36.150915 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27db2673-4c89-4952-9c11-9ababe13768b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:36.151650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27db2673-4c89-4952-9c11-9ababe13768b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:36.152151 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27db2673-4c89-4952-9c11-9ababe13768b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:36.152655 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-27db2673-4c89-4952-9c11-9ababe13768b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:36.305728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-27db2673-4c89-4952-9c11-9ababe13768b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:36.313808 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-27db2673-4c89-4952-9c11-9ababe13768b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.178826 Sep 11 08:52:36.314563 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 377/724] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:36 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:36.864537 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-311c4ebb-906e-448d-9ebe-48687480c922 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:36.865353 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-311c4ebb-906e-448d-9ebe-48687480c922 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:36.872414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311c4ebb-906e-448d-9ebe-48687480c922 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:36.872906 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311c4ebb-906e-448d-9ebe-48687480c922 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:36.873341 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311c4ebb-906e-448d-9ebe-48687480c922 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:36.874741 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311c4ebb-906e-448d-9ebe-48687480c922 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:36.875207 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311c4ebb-906e-448d-9ebe-48687480c922 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:36.875749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311c4ebb-906e-448d-9ebe-48687480c922 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:36.973633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-311c4ebb-906e-448d-9ebe-48687480c922 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lazy-loading 'services' on Instance uuid 078e3f41-48de-40ee-aa49-325547437728 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:52:37.221408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-311c4ebb-906e-448d-9ebe-48687480c922 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "DELETE /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728/os-volume_attachments/1cc9ffca-100b-4992-b8ea-bed0e3239ec3" status: 202 len: 0 microversion: 2.1 time: 0.360827 Sep 11 08:52:37.222554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 348/725] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:52:36 2022] DELETE /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728/os-volume_attachments/1cc9ffca-100b-4992-b8ea-bed0e3239ec3 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:52:37.340312 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-199a6246-afe4-4a85-a6d4-f60ec7b119ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:37.341226 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-199a6246-afe4-4a85-a6d4-f60ec7b119ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:37.349056 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-199a6246-afe4-4a85-a6d4-f60ec7b119ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:37.349730 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-199a6246-afe4-4a85-a6d4-f60ec7b119ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:37.350323 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-199a6246-afe4-4a85-a6d4-f60ec7b119ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:37.351111 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-199a6246-afe4-4a85-a6d4-f60ec7b119ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:37.351606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-199a6246-afe4-4a85-a6d4-f60ec7b119ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:37.352066 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-199a6246-afe4-4a85-a6d4-f60ec7b119ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:37.549974 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-199a6246-afe4-4a85-a6d4-f60ec7b119ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:37.552727 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:37.566011 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-199a6246-afe4-4a85-a6d4-f60ec7b119ae tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.231878 Sep 11 08:52:37.566741 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 378/726] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:37 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:37.751109 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-df96a649-9bbf-4cec-98e6-591800c635b7 req-897fad94-f612-45dd-8111-c67b680a3cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60e297f-d22d-4463-b9ed-d14b988add11", "name": "network-vif-plugged", "status": "completed", "tag": "d991a1cd-4fdf-4ff9-a1ce-1dea58bcca53"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:37.761630 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-df96a649-9bbf-4cec-98e6-591800c635b7 req-897fad94-f612-45dd-8111-c67b680a3cde service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:37.762119 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-df96a649-9bbf-4cec-98e6-591800c635b7 req-897fad94-f612-45dd-8111-c67b680a3cde service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:37.762668 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-df96a649-9bbf-4cec-98e6-591800c635b7 req-897fad94-f612-45dd-8111-c67b680a3cde service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:37.775548 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-df96a649-9bbf-4cec-98e6-591800c635b7 req-897fad94-f612-45dd-8111-c67b680a3cde service nova] Creating event network-vif-plugged:d991a1cd-4fdf-4ff9-a1ce-1dea58bcca53 for instance d60e297f-d22d-4463-b9ed-d14b988add11 on hv-cinder-85694 Sep 11 08:52:37.780729 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-df96a649-9bbf-4cec-98e6-591800c635b7 req-897fad94-f612-45dd-8111-c67b680a3cde service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034659 Sep 11 08:52:37.781308 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 349/727] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:52:38.592725 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1ab5e007-b9e4-4d2a-aba2-f94e6f5df2f3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:38.593559 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1ab5e007-b9e4-4d2a-aba2-f94e6f5df2f3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:38.596718 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:38.601742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ab5e007-b9e4-4d2a-aba2-f94e6f5df2f3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:38.602259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ab5e007-b9e4-4d2a-aba2-f94e6f5df2f3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:38.602688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ab5e007-b9e4-4d2a-aba2-f94e6f5df2f3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:38.603399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ab5e007-b9e4-4d2a-aba2-f94e6f5df2f3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:38.603850 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ab5e007-b9e4-4d2a-aba2-f94e6f5df2f3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:38.604269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ab5e007-b9e4-4d2a-aba2-f94e6f5df2f3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:38.771061 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1ab5e007-b9e4-4d2a-aba2-f94e6f5df2f3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:38.779913 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1ab5e007-b9e4-4d2a-aba2-f94e6f5df2f3 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.191305 Sep 11 08:52:38.780510 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 379/728] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:38 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:52:39.476979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-62e19b0c-b048-4609-acb9-1a00ecba31bd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:39.477770 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-62e19b0c-b048-4609-acb9-1a00ecba31bd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:39.484980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-62e19b0c-b048-4609-acb9-1a00ecba31bd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:39.485615 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-62e19b0c-b048-4609-acb9-1a00ecba31bd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:39.486312 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-62e19b0c-b048-4609-acb9-1a00ecba31bd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:39.487244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-62e19b0c-b048-4609-acb9-1a00ecba31bd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:39.487709 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-62e19b0c-b048-4609-acb9-1a00ecba31bd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:39.488141 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-62e19b0c-b048-4609-acb9-1a00ecba31bd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:39.519122 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-62e19b0c-b048-4609-acb9-1a00ecba31bd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:52:39.804749 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a98c47ac-ba65-49bf-824f-2ca8d9e37e8b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:39.805808 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a98c47ac-ba65-49bf-824f-2ca8d9e37e8b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:39.811161 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-62e19b0c-b048-4609-acb9-1a00ecba31bd tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "DELETE /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 204 len: 0 microversion: 2.1 time: 0.338032 Sep 11 08:52:39.813011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 350/729] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:52:39 2022] DELETE /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:52:39.821021 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a98c47ac-ba65-49bf-824f-2ca8d9e37e8b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:39.823331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a98c47ac-ba65-49bf-824f-2ca8d9e37e8b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:39.823331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a98c47ac-ba65-49bf-824f-2ca8d9e37e8b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:39.823823 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a98c47ac-ba65-49bf-824f-2ca8d9e37e8b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:39.824832 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a98c47ac-ba65-49bf-824f-2ca8d9e37e8b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:39.825541 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a98c47ac-ba65-49bf-824f-2ca8d9e37e8b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:39.827288 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4243d060-d8a1-420d-8d16-44522f72369c tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:39.828618 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4243d060-d8a1-420d-8d16-44522f72369c tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:39.839327 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4243d060-d8a1-420d-8d16-44522f72369c tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:39.840260 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4243d060-d8a1-420d-8d16-44522f72369c tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:39.841083 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4243d060-d8a1-420d-8d16-44522f72369c tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:39.843052 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4243d060-d8a1-420d-8d16-44522f72369c tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:39.843990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4243d060-d8a1-420d-8d16-44522f72369c tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:39.844785 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4243d060-d8a1-420d-8d16-44522f72369c tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:40.029618 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a98c47ac-ba65-49bf-824f-2ca8d9e37e8b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:40.043618 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4243d060-d8a1-420d-8d16-44522f72369c tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:40.045766 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a98c47ac-ba65-49bf-824f-2ca8d9e37e8b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1363 microversion: 2.1 time: 0.245224 Sep 11 08:52:40.046840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 380/730] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:39 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:40.049917 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4243d060-d8a1-420d-8d16-44522f72369c tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1514 microversion: 2.1 time: 0.231109 Sep 11 08:52:40.050551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 351/731] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:39 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:52:41.073550 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f2b459aa-3f44-4b55-9860-abac08d95b35 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:41.074319 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f2b459aa-3f44-4b55-9860-abac08d95b35 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:41.081393 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2b459aa-3f44-4b55-9860-abac08d95b35 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:41.081788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-20bbd742-73c2-4280-b833-3da1b1c7b626 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:41.082354 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2b459aa-3f44-4b55-9860-abac08d95b35 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:41.082354 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2b459aa-3f44-4b55-9860-abac08d95b35 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:41.082556 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-20bbd742-73c2-4280-b833-3da1b1c7b626 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:41.083033 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2b459aa-3f44-4b55-9860-abac08d95b35 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:41.083487 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2b459aa-3f44-4b55-9860-abac08d95b35 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:41.083912 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2b459aa-3f44-4b55-9860-abac08d95b35 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:41.089412 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20bbd742-73c2-4280-b833-3da1b1c7b626 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:41.089896 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20bbd742-73c2-4280-b833-3da1b1c7b626 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:41.090352 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20bbd742-73c2-4280-b833-3da1b1c7b626 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:41.091063 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20bbd742-73c2-4280-b833-3da1b1c7b626 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:41.091506 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20bbd742-73c2-4280-b833-3da1b1c7b626 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:41.091925 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20bbd742-73c2-4280-b833-3da1b1c7b626 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:41.254365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f2b459aa-3f44-4b55-9860-abac08d95b35 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:41.268275 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f2b459aa-3f44-4b55-9860-abac08d95b35 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1514 microversion: 2.1 time: 0.197860 Sep 11 08:52:41.269807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 381/732] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:41 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:41.300501 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-20bbd742-73c2-4280-b833-3da1b1c7b626 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:41.308708 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-20bbd742-73c2-4280-b833-3da1b1c7b626 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1548 microversion: 2.1 time: 0.231214 Sep 11 08:52:41.309313 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 352/733] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:41 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1548 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:41.348534 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c25a92e7-908c-4dfc-999d-75a0cd76b9a8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:41.349030 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c25a92e7-908c-4dfc-999d-75a0cd76b9a8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:41.355502 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c25a92e7-908c-4dfc-999d-75a0cd76b9a8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:41.355992 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c25a92e7-908c-4dfc-999d-75a0cd76b9a8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:41.356437 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c25a92e7-908c-4dfc-999d-75a0cd76b9a8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:41.357239 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c25a92e7-908c-4dfc-999d-75a0cd76b9a8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:41.357645 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c25a92e7-908c-4dfc-999d-75a0cd76b9a8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:41.358646 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c25a92e7-908c-4dfc-999d-75a0cd76b9a8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:41.442792 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c25a92e7-908c-4dfc-999d-75a0cd76b9a8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098396 Sep 11 08:52:41.443408 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 382/734] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 08:52:41 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:52:42.308935 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-27279fcc-1aa3-49b2-965d-6ed0464946ee tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:42.310080 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-27279fcc-1aa3-49b2-965d-6ed0464946ee tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:42.321631 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27279fcc-1aa3-49b2-965d-6ed0464946ee tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:42.322835 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27279fcc-1aa3-49b2-965d-6ed0464946ee tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:42.322835 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27279fcc-1aa3-49b2-965d-6ed0464946ee tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:42.324085 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27279fcc-1aa3-49b2-965d-6ed0464946ee tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:42.325011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27279fcc-1aa3-49b2-965d-6ed0464946ee tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:42.325779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27279fcc-1aa3-49b2-965d-6ed0464946ee tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:42.644766 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-27279fcc-1aa3-49b2-965d-6ed0464946ee tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:42.659963 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-27279fcc-1aa3-49b2-965d-6ed0464946ee tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1514 microversion: 2.1 time: 0.358489 Sep 11 08:52:42.664026 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 353/735] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:42 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1514 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:43.050416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-91456824-65e9-4779-94a1-810d2c98312f req-b28402a0-b3a0-4cf5-bc3d-c1c938795cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "078e3f41-48de-40ee-aa49-325547437728", "name": "network-vif-deleted", "tag": "d255b39d-ddad-478e-9681-9d6513dd3d8a"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:43.064870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-91456824-65e9-4779-94a1-810d2c98312f req-b28402a0-b3a0-4cf5-bc3d-c1c938795cca service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:43.065359 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-91456824-65e9-4779-94a1-810d2c98312f req-b28402a0-b3a0-4cf5-bc3d-c1c938795cca service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:43.065791 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-91456824-65e9-4779-94a1-810d2c98312f req-b28402a0-b3a0-4cf5-bc3d-c1c938795cca service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:43.084752 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-91456824-65e9-4779-94a1-810d2c98312f req-b28402a0-b3a0-4cf5-bc3d-c1c938795cca service nova] Creating event network-vif-deleted:d255b39d-ddad-478e-9681-9d6513dd3d8a for instance 078e3f41-48de-40ee-aa49-325547437728 on hv-cinder-85694 Sep 11 08:52:43.091097 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-91456824-65e9-4779-94a1-810d2c98312f req-b28402a0-b3a0-4cf5-bc3d-c1c938795cca service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049557 Sep 11 08:52:43.092396 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 383/736] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:52:43.165283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-6dc748dd-f03a-4d30-8e98-ed9eb329bc71 req-1b680137-ac60-46df-9e7e-702f2ace9076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60e297f-d22d-4463-b9ed-d14b988add11", "tag": "d991a1cd-4fdf-4ff9-a1ce-1dea58bcca53"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:43.184062 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-6dc748dd-f03a-4d30-8e98-ed9eb329bc71 req-1b680137-ac60-46df-9e7e-702f2ace9076 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:43.185342 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-6dc748dd-f03a-4d30-8e98-ed9eb329bc71 req-1b680137-ac60-46df-9e7e-702f2ace9076 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:43.186419 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-6dc748dd-f03a-4d30-8e98-ed9eb329bc71 req-1b680137-ac60-46df-9e7e-702f2ace9076 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:43.208636 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-6dc748dd-f03a-4d30-8e98-ed9eb329bc71 req-1b680137-ac60-46df-9e7e-702f2ace9076 service nova] Creating event network-changed:d991a1cd-4fdf-4ff9-a1ce-1dea58bcca53 for instance d60e297f-d22d-4463-b9ed-d14b988add11 on hv-cinder-85694 Sep 11 08:52:43.218163 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-6dc748dd-f03a-4d30-8e98-ed9eb329bc71 req-1b680137-ac60-46df-9e7e-702f2ace9076 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160690 Sep 11 08:52:43.219289 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 354/737] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:52:43.694469 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:43.695892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:43.704565 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:43.708445 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:43.708445 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:43.708445 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:43.708445 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:43.709130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:43.777899 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:43.779855 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:43.781408 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:43.782717 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lazy-loading 'fault' on Instance uuid 078e3f41-48de-40ee-aa49-325547437728 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:52:43.868164 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:43.883721 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b879fb24-bb60-4761-949a-85e28c03f04b tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 200 len: 1308 microversion: 2.1 time: 0.195500 Sep 11 08:52:43.900098 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 384/738] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:43 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:52:44.909972 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:44.910737 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: 078e3f41-48de-40ee-aa49-325547437728] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:44.917696 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:44.918225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:44.918672 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:44.919411 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:44.919877 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:44.920304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:44.938404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] HTTP exception thrown: Instance 078e3f41-48de-40ee-aa49-325547437728 could not be found. Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Request method failure captured: Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 HTTP/1.1 Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaGXLoMAwcFXPGfxwQZXt9Oe0NABj_yS42Unb-hLahM7OBFYLgVLEmLQ33pIGVRupqCKOntZ3iS0KKPe08_eOziUjZVYtqADsNa9kJHwXpZDjevXSwiOgnaxsgKBkeoQKhdEaFcSWg-n4SXU16PTZLuoHPKiURLk20rQWwT1cZDutB4 Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 94ceae42bd11404eaea28d523b98126e Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-VolumesSnapshotTestJSON-224181076 Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:52:44.940120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94ceae42bd11404eaea28d523b98126e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94ceae42bd11404eaea28d523b98126e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94ceae42bd11404eaea28d523b98126e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94ceae42bd11404eaea28d523b98126e", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-VolumesSnapshotTestJSON-224181076 Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 94ceae42bd11404eaea28d523b98126e Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-224181076 Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-VolumesSnapshotTestJSON-224181076-project Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: bae09cfbf3844b1682d8924e7d9578ee Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-VolumesSnapshotTestJSON-224181076-project Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance 078e3f41-48de-40ee-aa49-325547437728 could not be found. Sep 11 08:52:44.941633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': '078e3f41-48de-40ee-aa49-325547437728'} Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 078e3f41-48de-40ee-aa49-325547437728 could not be found. Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:52:44.942561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 078e3f41-48de-40ee-aa49-325547437728 could not be found. Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 078e3f41-48de-40ee-aa49-325547437728 could not be found. Sep 11 08:52:44.944013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:44.945579 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Returning 404 to user: Instance 078e3f41-48de-40ee-aa49-325547437728 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:52:44.945579 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-17c2aa46-b445-44b5-8699-664a943094e0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728" status: 404 len: 111 microversion: 2.1 time: 0.037587 Sep 11 08:52:44.945579 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 355/739] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:44 2022] GET /compute/v2.1/servers/078e3f41-48de-40ee-aa49-325547437728 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:52:45.773940 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e27caeea-aeff-4396-80dd-b03ce809758c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:45.774723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e27caeea-aeff-4396-80dd-b03ce809758c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:45.781786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e27caeea-aeff-4396-80dd-b03ce809758c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:45.782310 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e27caeea-aeff-4396-80dd-b03ce809758c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:45.782752 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e27caeea-aeff-4396-80dd-b03ce809758c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:45.783470 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e27caeea-aeff-4396-80dd-b03ce809758c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:45.783947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e27caeea-aeff-4396-80dd-b03ce809758c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:45.784369 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e27caeea-aeff-4396-80dd-b03ce809758c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:45.876228 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-e27caeea-aeff-4396-80dd-b03ce809758c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lazy-loading 'services' on Instance uuid ecad74b6-c736-4f92-9339-9fe3221c0700 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:52:46.197399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e27caeea-aeff-4396-80dd-b03ce809758c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments/a728429b-9511-4b79-bf35-1ea1451e6dc1" status: 202 len: 0 microversion: 2.1 time: 0.427287 Sep 11 08:52:46.198003 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 385/740] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:52:45 2022] DELETE /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments/a728429b-9511-4b79-bf35-1ea1451e6dc1 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 08:52:46.207742 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-08b17b15-8c9f-4542-a921-3d479e10b0f4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:46.209984 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-08b17b15-8c9f-4542-a921-3d479e10b0f4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:46.216902 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08b17b15-8c9f-4542-a921-3d479e10b0f4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:46.217840 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08b17b15-8c9f-4542-a921-3d479e10b0f4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:46.218311 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08b17b15-8c9f-4542-a921-3d479e10b0f4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:46.219028 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08b17b15-8c9f-4542-a921-3d479e10b0f4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:46.219483 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08b17b15-8c9f-4542-a921-3d479e10b0f4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:46.219909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08b17b15-8c9f-4542-a921-3d479e10b0f4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:46.253211 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-08b17b15-8c9f-4542-a921-3d479e10b0f4 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049716 Sep 11 08:52:46.253825 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 356/741] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:52:46 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:52:47.268404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f3253fe9-effe-4bf3-b868-1f74c78ca279 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:47.271017 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f3253fe9-effe-4bf3-b868-1f74c78ca279 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:47.277734 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3253fe9-effe-4bf3-b868-1f74c78ca279 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:47.280919 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3253fe9-effe-4bf3-b868-1f74c78ca279 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:47.280919 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3253fe9-effe-4bf3-b868-1f74c78ca279 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:47.280919 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3253fe9-effe-4bf3-b868-1f74c78ca279 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:47.280919 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3253fe9-effe-4bf3-b868-1f74c78ca279 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:47.281399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f3253fe9-effe-4bf3-b868-1f74c78ca279 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:47.316456 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f3253fe9-effe-4bf3-b868-1f74c78ca279 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053233 Sep 11 08:52:47.317053 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 386/742] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:52:47 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:52:48.330980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b7e3d60a-0b93-4060-a4fe-15e5e945eb4c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:48.333188 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b7e3d60a-0b93-4060-a4fe-15e5e945eb4c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:48.335931 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:48.341542 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7e3d60a-0b93-4060-a4fe-15e5e945eb4c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:48.342863 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7e3d60a-0b93-4060-a4fe-15e5e945eb4c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:48.343307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7e3d60a-0b93-4060-a4fe-15e5e945eb4c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:48.344176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7e3d60a-0b93-4060-a4fe-15e5e945eb4c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:48.344887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7e3d60a-0b93-4060-a4fe-15e5e945eb4c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:48.345581 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b7e3d60a-0b93-4060-a4fe-15e5e945eb4c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:48.391066 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b7e3d60a-0b93-4060-a4fe-15e5e945eb4c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065029 Sep 11 08:52:48.391839 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 357/743] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:52:48 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:52:49.406782 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a6dc78d7-488d-4fe8-8da4-ac1491be8755 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:49.408916 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a6dc78d7-488d-4fe8-8da4-ac1491be8755 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:49.415702 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a6dc78d7-488d-4fe8-8da4-ac1491be8755 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:49.416215 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a6dc78d7-488d-4fe8-8da4-ac1491be8755 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:49.416648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a6dc78d7-488d-4fe8-8da4-ac1491be8755 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:49.417340 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a6dc78d7-488d-4fe8-8da4-ac1491be8755 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:49.417791 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a6dc78d7-488d-4fe8-8da4-ac1491be8755 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:49.418236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a6dc78d7-488d-4fe8-8da4-ac1491be8755 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:49.449567 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a6dc78d7-488d-4fe8-8da4-ac1491be8755 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047414 Sep 11 08:52:49.450168 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 387/744] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:52:49 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:52:50.463102 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ccbc3a82-32d9-4a9a-9caf-58dcf95b4af5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:50.465311 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ccbc3a82-32d9-4a9a-9caf-58dcf95b4af5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:50.474022 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ccbc3a82-32d9-4a9a-9caf-58dcf95b4af5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:50.474533 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ccbc3a82-32d9-4a9a-9caf-58dcf95b4af5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:50.474965 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ccbc3a82-32d9-4a9a-9caf-58dcf95b4af5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:50.475746 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ccbc3a82-32d9-4a9a-9caf-58dcf95b4af5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:50.476196 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ccbc3a82-32d9-4a9a-9caf-58dcf95b4af5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:50.476614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ccbc3a82-32d9-4a9a-9caf-58dcf95b4af5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:50.506296 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:52:50.511463 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ccbc3a82-32d9-4a9a-9caf-58dcf95b4af5 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053596 Sep 11 08:52:50.512509 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 358/745] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:52:50 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 08:52:50.598188 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-109cce61-d7e2-455e-9d4f-01911b1468a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:50.598728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-109cce61-d7e2-455e-9d4f-01911b1468a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:50.605823 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-109cce61-d7e2-455e-9d4f-01911b1468a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:50.606342 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-109cce61-d7e2-455e-9d4f-01911b1468a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:50.606779 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-109cce61-d7e2-455e-9d4f-01911b1468a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:50.607581 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-109cce61-d7e2-455e-9d4f-01911b1468a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:50.607963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-109cce61-d7e2-455e-9d4f-01911b1468a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:50.608378 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-109cce61-d7e2-455e-9d4f-01911b1468a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:50.635770 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-109cce61-d7e2-455e-9d4f-01911b1468a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Going to try to terminate instance {{(pid=127646) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:52:50.954971 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-109cce61-d7e2-455e-9d4f-01911b1468a9 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 204 len: 0 microversion: 2.1 time: 0.360773 Sep 11 08:52:50.955566 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 388/746] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:52:50 2022] DELETE /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:52:50.967251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2ad0e390-4050-41f8-9f3f-f470a2fcc530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:50.967871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2ad0e390-4050-41f8-9f3f-f470a2fcc530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:50.976369 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ad0e390-4050-41f8-9f3f-f470a2fcc530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:50.976878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ad0e390-4050-41f8-9f3f-f470a2fcc530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:50.977384 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ad0e390-4050-41f8-9f3f-f470a2fcc530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:50.978166 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ad0e390-4050-41f8-9f3f-f470a2fcc530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:50.978650 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ad0e390-4050-41f8-9f3f-f470a2fcc530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:50.979112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2ad0e390-4050-41f8-9f3f-f470a2fcc530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:51.124944 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2ad0e390-4050-41f8-9f3f-f470a2fcc530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:51.132614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2ad0e390-4050-41f8-9f3f-f470a2fcc530 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1690 microversion: 2.1 time: 0.170266 Sep 11 08:52:51.133111 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 359/747] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:50 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:52.157112 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-684456dd-87e4-48da-8118-8cc4efd8b60a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:52.157724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-684456dd-87e4-48da-8118-8cc4efd8b60a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:52.164519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-684456dd-87e4-48da-8118-8cc4efd8b60a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:52.165009 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-684456dd-87e4-48da-8118-8cc4efd8b60a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:52.165446 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-684456dd-87e4-48da-8118-8cc4efd8b60a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:52.166203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-684456dd-87e4-48da-8118-8cc4efd8b60a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:52.166665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-684456dd-87e4-48da-8118-8cc4efd8b60a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:52.167093 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-684456dd-87e4-48da-8118-8cc4efd8b60a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:52.324428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-684456dd-87e4-48da-8118-8cc4efd8b60a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:52.333171 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-684456dd-87e4-48da-8118-8cc4efd8b60a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1690 microversion: 2.1 time: 0.180364 Sep 11 08:52:52.333776 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 389/748] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:52 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:53.358829 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bc26906e-aab8-436a-a049-bf42b171e6a3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:53.359690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bc26906e-aab8-436a-a049-bf42b171e6a3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:53.367390 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc26906e-aab8-436a-a049-bf42b171e6a3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:53.367890 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc26906e-aab8-436a-a049-bf42b171e6a3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:53.368338 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc26906e-aab8-436a-a049-bf42b171e6a3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:53.369056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc26906e-aab8-436a-a049-bf42b171e6a3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:53.369520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc26906e-aab8-436a-a049-bf42b171e6a3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:53.369950 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bc26906e-aab8-436a-a049-bf42b171e6a3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:53.514093 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bc26906e-aab8-436a-a049-bf42b171e6a3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:53.522647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bc26906e-aab8-436a-a049-bf42b171e6a3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1690 microversion: 2.1 time: 0.168159 Sep 11 08:52:53.523237 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 360/749] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:53 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:54.546194 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f6606bdd-7668-4c03-87d5-1b800fe10c68 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:54.546931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f6606bdd-7668-4c03-87d5-1b800fe10c68 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:54.554566 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6606bdd-7668-4c03-87d5-1b800fe10c68 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:54.555133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6606bdd-7668-4c03-87d5-1b800fe10c68 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:54.555772 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6606bdd-7668-4c03-87d5-1b800fe10c68 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:54.556508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6606bdd-7668-4c03-87d5-1b800fe10c68 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:54.556974 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6606bdd-7668-4c03-87d5-1b800fe10c68 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:54.557395 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f6606bdd-7668-4c03-87d5-1b800fe10c68 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:54.753899 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f6606bdd-7668-4c03-87d5-1b800fe10c68 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:54.762556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f6606bdd-7668-4c03-87d5-1b800fe10c68 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1690 microversion: 2.1 time: 0.220182 Sep 11 08:52:54.763162 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 390/750] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:54 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:55.790866 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1a381eaf-f72b-4a5d-b1a4-a55ebb56a59a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:55.791893 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1a381eaf-f72b-4a5d-b1a4-a55ebb56a59a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:55.806016 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1a381eaf-f72b-4a5d-b1a4-a55ebb56a59a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:55.806544 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1a381eaf-f72b-4a5d-b1a4-a55ebb56a59a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:55.806801 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1739350277", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "networks": [{"uuid": "b0a4670b-bd94-436f-8daa-872dcc71130d"}]}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:55.807731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1a381eaf-f72b-4a5d-b1a4-a55ebb56a59a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:55.808691 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1a381eaf-f72b-4a5d-b1a4-a55ebb56a59a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:55.809422 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1a381eaf-f72b-4a5d-b1a4-a55ebb56a59a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:55.809919 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1a381eaf-f72b-4a5d-b1a4-a55ebb56a59a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:55.880157 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] validate_networks() for [('b0a4670b-bd94-436f-8daa-872dcc71130d', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:52:55.995786 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1a381eaf-f72b-4a5d-b1a4-a55ebb56a59a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:56.015058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1a381eaf-f72b-4a5d-b1a4-a55ebb56a59a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1690 microversion: 2.1 time: 0.228521 Sep 11 08:52:56.018740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 361/751] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:55 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1690 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:56.503207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:52:56.503943 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:52:56.504767 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:52:56.505564 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:52:56.506296 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:52:56.522015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:56.522802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:56.523531 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:56.524841 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:56.525648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:56.526467 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:56.559224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Getting quotas for project 94ceae42bd11404eaea28d523b98126e. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:52:56.567738 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Getting quotas for user bae09cfbf3844b1682d8924e7d9578ee and project 94ceae42bd11404eaea28d523b98126e. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:52:56.591312 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:52:56.595854 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:52:56.853772 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8bf0d87f-5e56-489b-9b66-cb235ef72257 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050721 Sep 11 08:52:56.862306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 391/752] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:52:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 08:52:56.872422 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b6c5a6ac-3c57-4c3a-8657-1e976bb93404 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:56.874873 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b6c5a6ac-3c57-4c3a-8657-1e976bb93404 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:56.974031 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b6c5a6ac-3c57-4c3a-8657-1e976bb93404 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:56.984883 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b6c5a6ac-3c57-4c3a-8657-1e976bb93404 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1219 microversion: 2.1 time: 0.116564 Sep 11 08:52:56.996208 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 362/753] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:56 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:57.004245 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-d801b908-139b-4dfb-b02c-4ca156128bad req-c689cc3e-3bfc-4425-99c2-f4b9128d707e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecad74b6-c736-4f92-9339-9fe3221c0700", "name": "network-vif-deleted", "tag": "fb0a2c0a-f47e-49a3-a803-c69e51e3ed11"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:52:57.017550 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d801b908-139b-4dfb-b02c-4ca156128bad req-c689cc3e-3bfc-4425-99c2-f4b9128d707e service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:57.018047 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d801b908-139b-4dfb-b02c-4ca156128bad req-c689cc3e-3bfc-4425-99c2-f4b9128d707e service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:57.018514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d801b908-139b-4dfb-b02c-4ca156128bad req-c689cc3e-3bfc-4425-99c2-f4b9128d707e service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:57.032682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-d801b908-139b-4dfb-b02c-4ca156128bad req-c689cc3e-3bfc-4425-99c2-f4b9128d707e service nova] Creating event network-vif-deleted:fb0a2c0a-f47e-49a3-a803-c69e51e3ed11 for instance ecad74b6-c736-4f92-9339-9fe3221c0700 on hv-cinder-85694 Sep 11 08:52:57.039276 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-d801b908-139b-4dfb-b02c-4ca156128bad req-c689cc3e-3bfc-4425-99c2-f4b9128d707e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039690 Sep 11 08:52:57.039904 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 392/754] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:52:57.050500 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-85ddf336-dfa7-45fb-9138-d9ba3f11ab9d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:57.051030 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-85ddf336-dfa7-45fb-9138-d9ba3f11ab9d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:57.059200 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-85ddf336-dfa7-45fb-9138-d9ba3f11ab9d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:57.060281 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-85ddf336-dfa7-45fb-9138-d9ba3f11ab9d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:57.061452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-85ddf336-dfa7-45fb-9138-d9ba3f11ab9d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:57.062516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-85ddf336-dfa7-45fb-9138-d9ba3f11ab9d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:57.063153 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-85ddf336-dfa7-45fb-9138-d9ba3f11ab9d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:57.063840 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-85ddf336-dfa7-45fb-9138-d9ba3f11ab9d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:57.148633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-85ddf336-dfa7-45fb-9138-d9ba3f11ab9d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:57.158460 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-85ddf336-dfa7-45fb-9138-d9ba3f11ab9d tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1622 microversion: 2.1 time: 0.111930 Sep 11 08:52:57.164052 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 363/755] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:57 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1622 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:58.013572 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4dc7ae5b-736e-4e71-96ec-2229645eb282 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:58.014435 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4dc7ae5b-736e-4e71-96ec-2229645eb282 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:58.022308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc7ae5b-736e-4e71-96ec-2229645eb282 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:58.022817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc7ae5b-736e-4e71-96ec-2229645eb282 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:58.023237 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc7ae5b-736e-4e71-96ec-2229645eb282 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:58.026199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc7ae5b-736e-4e71-96ec-2229645eb282 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:58.026705 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc7ae5b-736e-4e71-96ec-2229645eb282 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:58.027363 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4dc7ae5b-736e-4e71-96ec-2229645eb282 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:58.101253 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4dc7ae5b-736e-4e71-96ec-2229645eb282 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:58.112380 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4dc7ae5b-736e-4e71-96ec-2229645eb282 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1223 microversion: 2.1 time: 0.103490 Sep 11 08:52:58.113784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 393/756] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:58 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:58.183680 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:58.184448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:58.192853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:58.194210 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:58.194745 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:58.195665 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:58.196216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:58.196788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:58.231520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:58.232001 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:58.232954 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:58.233408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lazy-loading 'fault' on Instance uuid ecad74b6-c736-4f92-9339-9fe3221c0700 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:52:58.292755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:58.303879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9c919661-4ba7-47ee-9a4c-5972b06ac43a tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 200 len: 1335 microversion: 2.1 time: 0.124236 Sep 11 08:52:58.311996 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 364/757] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:58 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 1335 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:52:59.140912 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0db05545-e233-44b7-97f7-cccb457c4352 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:59.141995 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0db05545-e233-44b7-97f7-cccb457c4352 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:59.153017 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0db05545-e233-44b7-97f7-cccb457c4352 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:59.154797 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0db05545-e233-44b7-97f7-cccb457c4352 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:59.155526 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0db05545-e233-44b7-97f7-cccb457c4352 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:59.156809 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0db05545-e233-44b7-97f7-cccb457c4352 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:59.157614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0db05545-e233-44b7-97f7-cccb457c4352 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:59.158394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0db05545-e233-44b7-97f7-cccb457c4352 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:59.235108 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0db05545-e233-44b7-97f7-cccb457c4352 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:52:59.243263 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0db05545-e233-44b7-97f7-cccb457c4352 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1271 microversion: 2.1 time: 0.110003 Sep 11 08:52:59.244163 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 394/758] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:59 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:52:59.328439 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:59.329124 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: ecad74b6-c736-4f92-9339-9fe3221c0700] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:52:59.336206 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:59.336702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:59.337146 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:59.337863 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:52:59.338366 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:52:59.338806 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:52:59.354978 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] HTTP exception thrown: Instance ecad74b6-c736-4f92-9339-9fe3221c0700 could not be found. Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Request method failure captured: Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 HTTP/1.1 Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaCAu486B1xOWjzoN32Ui9eEOSqsCt3PPO76qh3QezPV599Kfd26fIVevOl2XWy4ljtSLDXXhbgXhEByiOZUCykRIKveORgcox18nSEtMQfNksuGMDm5LQpWcCuCK28TkehgbbHx8cYJignj8hbMDx_f29oWsYlEYPPugfePpJOGrDM Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: bcb554b6cf504ca9a30a1ea871364e3d Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:52:59.356562 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bcb554b6cf504ca9a30a1ea871364e3d", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: bcb554b6cf504ca9a30a1ea871364e3d Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-ServerRescueNegativeTestJSON-1061498163-project Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 2aea4a0e0ec74c538735b890fb774b14 Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1061498163-project Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance ecad74b6-c736-4f92-9339-9fe3221c0700 could not be found. Sep 11 08:52:59.360273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'ecad74b6-c736-4f92-9339-9fe3221c0700'} Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecad74b6-c736-4f92-9339-9fe3221c0700 could not be found. Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:52:59.362140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecad74b6-c736-4f92-9339-9fe3221c0700 could not be found. Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecad74b6-c736-4f92-9339-9fe3221c0700 could not be found. Sep 11 08:52:59.364909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:52:59.367489 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Returning 404 to user: Instance ecad74b6-c736-4f92-9339-9fe3221c0700 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:52:59.367489 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a90e88b8-f21d-4035-990b-0227250b4a31 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700" status: 404 len: 111 microversion: 2.1 time: 0.034718 Sep 11 08:52:59.367489 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 365/759] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:52:59 2022] GET /compute/v2.1/servers/ecad74b6-c736-4f92-9339-9fe3221c0700 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:52:59.370558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b84c0fb6-feb4-4301-a9ec-ffbbd90c8d89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '.version_select at 0x7fb27ebdc670>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:52:59.463949 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b84c0fb6-feb4-4301-a9ec-ffbbd90c8d89 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370435579" status: 202 len: 0 microversion: 2.1 time: 0.097306 Sep 11 08:52:59.464537 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 395/760] 10.222.0.44 () {58 vars in 1221 bytes} [Sun Sep 11 08:52:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370435579 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 08:53:00.274204 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-21938255-a07f-40ea-b138-f19dd6e951ea tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:00.275288 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-21938255-a07f-40ea-b138-f19dd6e951ea tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:00.287944 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21938255-a07f-40ea-b138-f19dd6e951ea tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:00.289142 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21938255-a07f-40ea-b138-f19dd6e951ea tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:00.289786 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21938255-a07f-40ea-b138-f19dd6e951ea tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:00.290879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21938255-a07f-40ea-b138-f19dd6e951ea tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:00.291349 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21938255-a07f-40ea-b138-f19dd6e951ea tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:00.291790 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-21938255-a07f-40ea-b138-f19dd6e951ea tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:00.379417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-21938255-a07f-40ea-b138-f19dd6e951ea tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:00.388123 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-21938255-a07f-40ea-b138-f19dd6e951ea tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1277 microversion: 2.1 time: 0.121979 Sep 11 08:53:00.389425 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 366/761] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:00 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:01.428556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c473e913-bf6b-4413-8061-ee66b9251b4d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:01.429188 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c473e913-bf6b-4413-8061-ee66b9251b4d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:01.436732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c473e913-bf6b-4413-8061-ee66b9251b4d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:01.437312 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c473e913-bf6b-4413-8061-ee66b9251b4d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:01.437800 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c473e913-bf6b-4413-8061-ee66b9251b4d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:01.438700 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c473e913-bf6b-4413-8061-ee66b9251b4d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:01.439242 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c473e913-bf6b-4413-8061-ee66b9251b4d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:01.439723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c473e913-bf6b-4413-8061-ee66b9251b4d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:01.446634 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:01.706708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c473e913-bf6b-4413-8061-ee66b9251b4d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:01.715525 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c473e913-bf6b-4413-8061-ee66b9251b4d tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1319 microversion: 2.1 time: 0.291611 Sep 11 08:53:01.716122 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 396/762] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:01 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:02.522808 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-fe95bcd5-c5eb-4354-a397-38c79503e83b req-fc07163c-9003-4c2d-acf4-60f03d620108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0886581-401f-4faa-ac8b-1a5982e4f42c", "tag": "596c3071-5314-4f5b-860c-696e06936266"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:02.540615 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-fe95bcd5-c5eb-4354-a397-38c79503e83b req-fc07163c-9003-4c2d-acf4-60f03d620108 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:02.541109 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-fe95bcd5-c5eb-4354-a397-38c79503e83b req-fc07163c-9003-4c2d-acf4-60f03d620108 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:02.541548 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-fe95bcd5-c5eb-4354-a397-38c79503e83b req-fc07163c-9003-4c2d-acf4-60f03d620108 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:02.555716 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-fe95bcd5-c5eb-4354-a397-38c79503e83b req-fc07163c-9003-4c2d-acf4-60f03d620108 service nova] Creating event network-changed:596c3071-5314-4f5b-860c-696e06936266 for instance d0886581-401f-4faa-ac8b-1a5982e4f42c on hv-cinder-85694 Sep 11 08:53:02.562889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-fe95bcd5-c5eb-4354-a397-38c79503e83b req-fc07163c-9003-4c2d-acf4-60f03d620108 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056080 Sep 11 08:53:02.563798 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 367/763] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:02.758709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-765bd288-6a07-4409-9c91-378ce4f78950 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:02.760766 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-765bd288-6a07-4409-9c91-378ce4f78950 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:02.772779 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-765bd288-6a07-4409-9c91-378ce4f78950 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:02.773622 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-765bd288-6a07-4409-9c91-378ce4f78950 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:02.774488 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-765bd288-6a07-4409-9c91-378ce4f78950 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:02.775836 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-765bd288-6a07-4409-9c91-378ce4f78950 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:02.776657 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-765bd288-6a07-4409-9c91-378ce4f78950 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:02.777445 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-765bd288-6a07-4409-9c91-378ce4f78950 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:03.020255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-765bd288-6a07-4409-9c91-378ce4f78950 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:03.028281 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-765bd288-6a07-4409-9c91-378ce4f78950 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1319 microversion: 2.1 time: 0.276516 Sep 11 08:53:03.029431 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 397/764] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:02 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:03.560983 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6b9f0fd5-5c74-4d81-9d75-54e9b261034c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:03.561569 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6b9f0fd5-5c74-4d81-9d75-54e9b261034c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:03.569059 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b9f0fd5-5c74-4d81-9d75-54e9b261034c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:03.569584 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b9f0fd5-5c74-4d81-9d75-54e9b261034c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:03.570023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b9f0fd5-5c74-4d81-9d75-54e9b261034c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:03.570766 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b9f0fd5-5c74-4d81-9d75-54e9b261034c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:03.571222 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b9f0fd5-5c74-4d81-9d75-54e9b261034c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:03.571646 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b9f0fd5-5c74-4d81-9d75-54e9b261034c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:03.599445 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6b9f0fd5-5c74-4d81-9d75-54e9b261034c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:53:03.948322 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6b9f0fd5-5c74-4d81-9d75-54e9b261034c tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "DELETE /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 204 len: 0 microversion: 2.1 time: 0.391860 Sep 11 08:53:03.948911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 368/765] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:53:03 2022] DELETE /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:53:03.956949 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0bc9b080-effd-4ed3-be2c-cc582092be58 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:03.957595 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0bc9b080-effd-4ed3-be2c-cc582092be58 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:03.963978 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bc9b080-effd-4ed3-be2c-cc582092be58 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:03.964508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bc9b080-effd-4ed3-be2c-cc582092be58 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:03.964930 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bc9b080-effd-4ed3-be2c-cc582092be58 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:03.965607 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bc9b080-effd-4ed3-be2c-cc582092be58 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:03.966049 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bc9b080-effd-4ed3-be2c-cc582092be58 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:03.966490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bc9b080-effd-4ed3-be2c-cc582092be58 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:04.054310 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1cdd86b6-899f-4a02-a0c3-3440f0a23cf7 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:04.055612 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1cdd86b6-899f-4a02-a0c3-3440f0a23cf7 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:04.065710 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1cdd86b6-899f-4a02-a0c3-3440f0a23cf7 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:04.066221 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1cdd86b6-899f-4a02-a0c3-3440f0a23cf7 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:04.066658 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1cdd86b6-899f-4a02-a0c3-3440f0a23cf7 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:04.067355 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1cdd86b6-899f-4a02-a0c3-3440f0a23cf7 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:04.067801 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1cdd86b6-899f-4a02-a0c3-3440f0a23cf7 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:04.068220 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1cdd86b6-899f-4a02-a0c3-3440f0a23cf7 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:04.108404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0bc9b080-effd-4ed3-be2c-cc582092be58 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:04.116676 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0bc9b080-effd-4ed3-be2c-cc582092be58 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1504 microversion: 2.1 time: 0.163530 Sep 11 08:53:04.117484 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 398/766] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:03 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:04.204263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1cdd86b6-899f-4a02-a0c3-3440f0a23cf7 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:04.211949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1cdd86b6-899f-4a02-a0c3-3440f0a23cf7 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1319 microversion: 2.1 time: 0.162820 Sep 11 08:53:04.212515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 369/767] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:04 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:05.141011 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e939af32-2b5f-4115-a99c-30d1b77e5d33 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:05.141576 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e939af32-2b5f-4115-a99c-30d1b77e5d33 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:05.149151 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e939af32-2b5f-4115-a99c-30d1b77e5d33 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:05.149723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e939af32-2b5f-4115-a99c-30d1b77e5d33 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:05.150193 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e939af32-2b5f-4115-a99c-30d1b77e5d33 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:05.151068 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e939af32-2b5f-4115-a99c-30d1b77e5d33 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:05.151519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e939af32-2b5f-4115-a99c-30d1b77e5d33 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:05.151944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e939af32-2b5f-4115-a99c-30d1b77e5d33 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:05.234931 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8faf31a3-ae10-4953-a3c4-85f82111b981 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:05.235550 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8faf31a3-ae10-4953-a3c4-85f82111b981 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:05.242700 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8faf31a3-ae10-4953-a3c4-85f82111b981 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:05.243188 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8faf31a3-ae10-4953-a3c4-85f82111b981 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:05.243617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8faf31a3-ae10-4953-a3c4-85f82111b981 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:05.244321 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8faf31a3-ae10-4953-a3c4-85f82111b981 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:05.244770 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8faf31a3-ae10-4953-a3c4-85f82111b981 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:05.245190 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8faf31a3-ae10-4953-a3c4-85f82111b981 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:05.298911 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e939af32-2b5f-4115-a99c-30d1b77e5d33 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:05.307217 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e939af32-2b5f-4115-a99c-30d1b77e5d33 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1504 microversion: 2.1 time: 0.170878 Sep 11 08:53:05.307981 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 399/768] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:05 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:05.399984 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8faf31a3-ae10-4953-a3c4-85f82111b981 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:05.408506 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8faf31a3-ae10-4953-a3c4-85f82111b981 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1319 microversion: 2.1 time: 0.177659 Sep 11 08:53:05.409093 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 370/769] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:05 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:06.335840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1cd59a0f-9d4d-48a6-a382-7ea1a4c49ff2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:06.336479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1cd59a0f-9d4d-48a6-a382-7ea1a4c49ff2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:06.343919 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1cd59a0f-9d4d-48a6-a382-7ea1a4c49ff2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:06.344377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1cd59a0f-9d4d-48a6-a382-7ea1a4c49ff2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:06.344811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1cd59a0f-9d4d-48a6-a382-7ea1a4c49ff2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:06.345512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1cd59a0f-9d4d-48a6-a382-7ea1a4c49ff2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:06.345954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1cd59a0f-9d4d-48a6-a382-7ea1a4c49ff2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:06.346411 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1cd59a0f-9d4d-48a6-a382-7ea1a4c49ff2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:06.432460 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c29961af-c6dd-4314-a922-f5136f6e28d5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:06.433064 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c29961af-c6dd-4314-a922-f5136f6e28d5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:06.439699 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c29961af-c6dd-4314-a922-f5136f6e28d5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:06.440892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c29961af-c6dd-4314-a922-f5136f6e28d5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:06.440892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c29961af-c6dd-4314-a922-f5136f6e28d5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:06.441436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c29961af-c6dd-4314-a922-f5136f6e28d5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:06.441889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c29961af-c6dd-4314-a922-f5136f6e28d5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:06.443088 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c29961af-c6dd-4314-a922-f5136f6e28d5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:06.541735 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:06.582337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1cd59a0f-9d4d-48a6-a382-7ea1a4c49ff2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:06.584753 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=6 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:06.596258 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1cd59a0f-9d4d-48a6-a382-7ea1a4c49ff2 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1504 microversion: 2.1 time: 0.263402 Sep 11 08:53:06.596258 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 400/770] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:06 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:06.604552 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c29961af-c6dd-4314-a922-f5136f6e28d5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:06.613590 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c29961af-c6dd-4314-a922-f5136f6e28d5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1319 microversion: 2.1 time: 0.185489 Sep 11 08:53:06.614646 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 371/771] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:06 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:07.061666 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-84839dec-654d-4139-a722-30631c212356 req-3ab56d73-2aa1-4ba8-9659-408e66d41997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ab3837-2058-4f46-8361-2535358fced8", "name": "network-vif-deleted", "tag": "a4e1aef8-2ebd-4142-9d16-5aae187c8a59"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:07.072315 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-84839dec-654d-4139-a722-30631c212356 req-3ab56d73-2aa1-4ba8-9659-408e66d41997 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:07.072796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-84839dec-654d-4139-a722-30631c212356 req-3ab56d73-2aa1-4ba8-9659-408e66d41997 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:07.073227 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-84839dec-654d-4139-a722-30631c212356 req-3ab56d73-2aa1-4ba8-9659-408e66d41997 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:07.085158 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-84839dec-654d-4139-a722-30631c212356 req-3ab56d73-2aa1-4ba8-9659-408e66d41997 service nova] Creating event network-vif-deleted:a4e1aef8-2ebd-4142-9d16-5aae187c8a59 for instance 18ab3837-2058-4f46-8361-2535358fced8 on hv-cinder-85694 Sep 11 08:53:07.091852 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-84839dec-654d-4139-a722-30631c212356 req-3ab56d73-2aa1-4ba8-9659-408e66d41997 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035638 Sep 11 08:53:07.092596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 401/772] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:07.623208 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c6ec3e3a-c2b4-4574-9db8-5a1eea5fadd1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:07.623780 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c6ec3e3a-c2b4-4574-9db8-5a1eea5fadd1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:07.625793 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:07.631840 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6ec3e3a-c2b4-4574-9db8-5a1eea5fadd1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:07.632792 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6ec3e3a-c2b4-4574-9db8-5a1eea5fadd1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:07.632905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6ec3e3a-c2b4-4574-9db8-5a1eea5fadd1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:07.633565 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6ec3e3a-c2b4-4574-9db8-5a1eea5fadd1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:07.634015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6ec3e3a-c2b4-4574-9db8-5a1eea5fadd1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:07.634624 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6ec3e3a-c2b4-4574-9db8-5a1eea5fadd1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:07.640621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e4c3b5ed-591e-4986-b3b1-f3073f30d568 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:07.641572 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e4c3b5ed-591e-4986-b3b1-f3073f30d568 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:07.648343 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4c3b5ed-591e-4986-b3b1-f3073f30d568 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:07.648838 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4c3b5ed-591e-4986-b3b1-f3073f30d568 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:07.649650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4c3b5ed-591e-4986-b3b1-f3073f30d568 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:07.651136 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4c3b5ed-591e-4986-b3b1-f3073f30d568 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:07.651979 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4c3b5ed-591e-4986-b3b1-f3073f30d568 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:07.652578 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4c3b5ed-591e-4986-b3b1-f3073f30d568 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:07.782113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c6ec3e3a-c2b4-4574-9db8-5a1eea5fadd1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:07.782113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c6ec3e3a-c2b4-4574-9db8-5a1eea5fadd1 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1290 microversion: 2.1 time: 0.111568 Sep 11 08:53:07.782113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 372/773] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:07 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1290 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:07.834023 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e4c3b5ed-591e-4986-b3b1-f3073f30d568 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:07.842879 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e4c3b5ed-591e-4986-b3b1-f3073f30d568 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1319 microversion: 2.1 time: 0.208652 Sep 11 08:53:07.843571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 402/774] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:07 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:08.134474 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-2488da37-fab2-4cad-9410-1d7174be6f7e req-e92aad32-d202-4ddd-8b51-e245d69a3249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0886581-401f-4faa-ac8b-1a5982e4f42c", "name": "network-vif-plugged", "status": "completed", "tag": "596c3071-5314-4f5b-860c-696e06936266"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:08.145195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-2488da37-fab2-4cad-9410-1d7174be6f7e req-e92aad32-d202-4ddd-8b51-e245d69a3249 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:08.150040 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-2488da37-fab2-4cad-9410-1d7174be6f7e req-e92aad32-d202-4ddd-8b51-e245d69a3249 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:08.150040 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-2488da37-fab2-4cad-9410-1d7174be6f7e req-e92aad32-d202-4ddd-8b51-e245d69a3249 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:08.158837 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-2488da37-fab2-4cad-9410-1d7174be6f7e req-e92aad32-d202-4ddd-8b51-e245d69a3249 service nova] Creating event network-vif-plugged:596c3071-5314-4f5b-860c-696e06936266 for instance d0886581-401f-4faa-ac8b-1a5982e4f42c on hv-cinder-85694 Sep 11 08:53:08.164079 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-2488da37-fab2-4cad-9410-1d7174be6f7e req-e92aad32-d202-4ddd-8b51-e245d69a3249 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094238 Sep 11 08:53:08.164588 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 373/775] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:08.760140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:08.760868 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:08.764477 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:08.770733 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:08.771595 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:08.772367 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:08.773352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:08.774084 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:08.774664 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:08.822514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:08.822986 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:08.823409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:08.823847 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lazy-loading 'fault' on Instance uuid 18ab3837-2058-4f46-8361-2535358fced8 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:53:08.867692 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:08.871999 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4ae3e7fe-a872-472b-af1c-bbe1e2fb2b20 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:08.873340 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4ae3e7fe-a872-472b-af1c-bbe1e2fb2b20 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:08.877702 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ce24559e-4dff-4ad3-ba4c-268f9c69f9cf tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 200 len: 1309 microversion: 2.1 time: 0.122259 Sep 11 08:53:08.878804 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 403/776] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:08 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:08.885146 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae3e7fe-a872-472b-af1c-bbe1e2fb2b20 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:08.885720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae3e7fe-a872-472b-af1c-bbe1e2fb2b20 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:08.886346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae3e7fe-a872-472b-af1c-bbe1e2fb2b20 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:08.887104 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae3e7fe-a872-472b-af1c-bbe1e2fb2b20 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:08.887573 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae3e7fe-a872-472b-af1c-bbe1e2fb2b20 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:08.888054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4ae3e7fe-a872-472b-af1c-bbe1e2fb2b20 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:09.058720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4ae3e7fe-a872-472b-af1c-bbe1e2fb2b20 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:09.067478 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4ae3e7fe-a872-472b-af1c-bbe1e2fb2b20 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1319 microversion: 2.1 time: 0.204205 Sep 11 08:53:09.068123 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 374/777] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:08 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:09.913584 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:09.914263 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 18ab3837-2058-4f46-8361-2535358fced8] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:09.921723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:09.922251 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:09.922840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:09.923568 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:09.924018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:09.924449 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:09.939227 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] HTTP exception thrown: Instance 18ab3837-2058-4f46-8361-2535358fced8 could not be found. Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Request method failure captured: Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 HTTP/1.1 Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaCAu486B1xOWjzoN32Ui9eEOSqsCt3PPO76qh3QezPV599Kfd26fIVevOl2XWy4ljtSLDXXhbgXhEByiOZUCykRIKveORgcox18nSEtMQfNksuGMDm5LQpWcCuCK28TkehgbbHx8cYJignj8hbMDx_f29oWsYlEYPPugfePpJOGrDM Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: bcb554b6cf504ca9a30a1ea871364e3d Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:53:09.940788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bcb554b6cf504ca9a30a1ea871364e3d", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: bcb554b6cf504ca9a30a1ea871364e3d Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-ServerRescueNegativeTestJSON-1061498163-project Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: 2aea4a0e0ec74c538735b890fb774b14 Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1061498163-project Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance 18ab3837-2058-4f46-8361-2535358fced8 could not be found. Sep 11 08:53:09.943830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': '18ab3837-2058-4f46-8361-2535358fced8'} Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ab3837-2058-4f46-8361-2535358fced8 could not be found. Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:53:09.945609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ab3837-2058-4f46-8361-2535358fced8 could not be found. Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ab3837-2058-4f46-8361-2535358fced8 could not be found. Sep 11 08:53:09.948693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:09.951824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Returning 404 to user: Instance 18ab3837-2058-4f46-8361-2535358fced8 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:53:09.951824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-90b32612-86a3-4b58-aa5c-91e7832047f3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8" status: 404 len: 111 microversion: 2.1 time: 0.032788 Sep 11 08:53:09.951824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 404/778] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:09 2022] GET /compute/v2.1/servers/18ab3837-2058-4f46-8361-2535358fced8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:53:09.952299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f02a7ac4-aa15-442b-8f18-f28b9ff63ddd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:09.952299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f02a7ac4-aa15-442b-8f18-f28b9ff63ddd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:09.959361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f02a7ac4-aa15-442b-8f18-f28b9ff63ddd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:09.959851 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f02a7ac4-aa15-442b-8f18-f28b9ff63ddd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:09.960290 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f02a7ac4-aa15-442b-8f18-f28b9ff63ddd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:09.961004 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f02a7ac4-aa15-442b-8f18-f28b9ff63ddd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:09.961462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f02a7ac4-aa15-442b-8f18-f28b9ff63ddd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:09.961887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f02a7ac4-aa15-442b-8f18-f28b9ff63ddd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:09.989740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f02a7ac4-aa15-442b-8f18-f28b9ff63ddd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:53:10.028513 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:10.092176 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4720098a-c84a-4675-bca3-fe36935783de tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:10.092892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4720098a-c84a-4675-bca3-fe36935783de tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:10.100178 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4720098a-c84a-4675-bca3-fe36935783de tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:10.100661 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4720098a-c84a-4675-bca3-fe36935783de tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:10.101093 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4720098a-c84a-4675-bca3-fe36935783de tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:10.101785 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4720098a-c84a-4675-bca3-fe36935783de tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:10.102267 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4720098a-c84a-4675-bca3-fe36935783de tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:10.102683 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4720098a-c84a-4675-bca3-fe36935783de tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:10.234770 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4720098a-c84a-4675-bca3-fe36935783de tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:10.242448 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4720098a-c84a-4675-bca3-fe36935783de tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1319 microversion: 2.1 time: 0.155253 Sep 11 08:53:10.250373 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 405/779] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:10 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:10.250373 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6a08bd3d-f3dd-49b3-8ed3-614ad65e6e52 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:10.250373 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6a08bd3d-f3dd-49b3-8ed3-614ad65e6e52 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:10.254722 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a08bd3d-f3dd-49b3-8ed3-614ad65e6e52 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:10.257556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a08bd3d-f3dd-49b3-8ed3-614ad65e6e52 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:10.257556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a08bd3d-f3dd-49b3-8ed3-614ad65e6e52 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:10.257556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a08bd3d-f3dd-49b3-8ed3-614ad65e6e52 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:10.257556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a08bd3d-f3dd-49b3-8ed3-614ad65e6e52 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:10.257961 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6a08bd3d-f3dd-49b3-8ed3-614ad65e6e52 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:10.285528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6a08bd3d-f3dd-49b3-8ed3-614ad65e6e52 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/ips" status: 200 len: 152 microversion: 2.20 time: 0.041329 Sep 11 08:53:10.286218 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 406/780] 10.222.0.44 () {60 vars in 1289 bytes} [Sun Sep 11 08:53:10 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 11 08:53:10.308461 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f02a7ac4-aa15-442b-8f18-f28b9ff63ddd tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 204 len: 0 microversion: 2.1 time: 0.360930 Sep 11 08:53:10.309182 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 375/781] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:53:09 2022] DELETE /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 08:53:10.317962 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-84f5df22-33f7-4140-9df5-29f8400178c3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:10.319737 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-84f5df22-33f7-4140-9df5-29f8400178c3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:10.325013 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-84f5df22-33f7-4140-9df5-29f8400178c3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:10.326250 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-84f5df22-33f7-4140-9df5-29f8400178c3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:10.326786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-84f5df22-33f7-4140-9df5-29f8400178c3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:10.327668 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-84f5df22-33f7-4140-9df5-29f8400178c3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:10.328197 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-84f5df22-33f7-4140-9df5-29f8400178c3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:10.328689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-84f5df22-33f7-4140-9df5-29f8400178c3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:10.479473 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-84f5df22-33f7-4140-9df5-29f8400178c3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:10.488803 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-84f5df22-33f7-4140-9df5-29f8400178c3 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.174621 Sep 11 08:53:10.489646 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 407/782] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:10 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:11.267352 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6ad7b223-1f53-4945-84a9-1eabf60b355e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:11.268249 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6ad7b223-1f53-4945-84a9-1eabf60b355e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:11.275523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ad7b223-1f53-4945-84a9-1eabf60b355e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:11.276108 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ad7b223-1f53-4945-84a9-1eabf60b355e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:11.281054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ad7b223-1f53-4945-84a9-1eabf60b355e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:11.281054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ad7b223-1f53-4945-84a9-1eabf60b355e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:11.281054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ad7b223-1f53-4945-84a9-1eabf60b355e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:11.281054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ad7b223-1f53-4945-84a9-1eabf60b355e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:11.414735 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6ad7b223-1f53-4945-84a9-1eabf60b355e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:11.423172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6ad7b223-1f53-4945-84a9-1eabf60b355e tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1509 microversion: 2.1 time: 0.160295 Sep 11 08:53:11.423754 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 376/783] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:11 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:11.446169 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4658ac34-97ff-4843-bbff-381ec6503cf9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e27a884a-a995-43c3-ab91-a1845f6196e5", "device": "/dev/sdb"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:11.448623 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4658ac34-97ff-4843-bbff-381ec6503cf9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:11.455735 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4658ac34-97ff-4843-bbff-381ec6503cf9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:11.456214 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4658ac34-97ff-4843-bbff-381ec6503cf9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:11.456645 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4658ac34-97ff-4843-bbff-381ec6503cf9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:11.457336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4658ac34-97ff-4843-bbff-381ec6503cf9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:11.457783 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4658ac34-97ff-4843-bbff-381ec6503cf9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:11.458230 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4658ac34-97ff-4843-bbff-381ec6503cf9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:11.512558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-561e221e-aca7-44e3-875c-39fca23b126b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:11.513715 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-561e221e-aca7-44e3-875c-39fca23b126b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:11.519895 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-561e221e-aca7-44e3-875c-39fca23b126b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:11.520377 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-561e221e-aca7-44e3-875c-39fca23b126b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:11.520806 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-561e221e-aca7-44e3-875c-39fca23b126b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:11.521505 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-561e221e-aca7-44e3-875c-39fca23b126b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:11.522160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-561e221e-aca7-44e3-875c-39fca23b126b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:11.522604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-561e221e-aca7-44e3-875c-39fca23b126b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:11.680903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-561e221e-aca7-44e3-875c-39fca23b126b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:11.689041 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-561e221e-aca7-44e3-875c-39fca23b126b tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.180206 Sep 11 08:53:11.689616 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 377/784] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:11 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:12.469149 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e90a831f-5143-46a8-acc5-230737ef9f7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:12.469883 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e90a831f-5143-46a8-acc5-230737ef9f7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:12.476581 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e90a831f-5143-46a8-acc5-230737ef9f7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:12.477070 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e90a831f-5143-46a8-acc5-230737ef9f7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:12.477592 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e90a831f-5143-46a8-acc5-230737ef9f7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:12.478352 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e90a831f-5143-46a8-acc5-230737ef9f7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:12.478804 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e90a831f-5143-46a8-acc5-230737ef9f7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:12.479233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e90a831f-5143-46a8-acc5-230737ef9f7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:12.505538 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-e90a831f-5143-46a8-acc5-230737ef9f7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lazy-loading 'flavor' on Instance uuid 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:53:12.982199 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e90a831f-5143-46a8-acc5-230737ef9f7c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "POST /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/action" status: 202 len: 0 microversion: 2.20 time: 0.516966 Sep 11 08:53:12.983546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 378/785] 10.222.0.44 () {62 vars in 1319 bytes} [Sun Sep 11 08:53:12 2022] POST /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 08:53:12.988722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-733344a1-ed1d-4a6b-9364-0822a59b7a43 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:12.989422 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-733344a1-ed1d-4a6b-9364-0822a59b7a43 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:12.995841 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-733344a1-ed1d-4a6b-9364-0822a59b7a43 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:12.996329 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-733344a1-ed1d-4a6b-9364-0822a59b7a43 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:12.996856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-733344a1-ed1d-4a6b-9364-0822a59b7a43 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:12.997558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-733344a1-ed1d-4a6b-9364-0822a59b7a43 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:12.998012 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-733344a1-ed1d-4a6b-9364-0822a59b7a43 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:12.998500 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-733344a1-ed1d-4a6b-9364-0822a59b7a43 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:13.144526 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-733344a1-ed1d-4a6b-9364-0822a59b7a43 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:13.155051 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-733344a1-ed1d-4a6b-9364-0822a59b7a43 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1520 microversion: 2.1 time: 0.169888 Sep 11 08:53:13.155705 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 379/786] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:12 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:13.160886 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:13.161379 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:13.167937 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:13.168423 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:13.171259 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:13.171259 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:13.171259 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:13.171259 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:13.319970 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:13.329509 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:13.330966 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:13.332244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a59d37f2-a955-4f15-9714-8c03b5da6ec3 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.175537 Sep 11 08:53:13.332740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 380/787] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:13 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:13.695722 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4658ac34-97ff-4843-bbff-381ec6503cf9 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "POST /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.253258 Sep 11 08:53:13.696394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 408/788] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:53:11 2022] POST /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c/os-volume_attachments => generated 194 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:13.933794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-ea6ad87d-3c65-4ab8-a415-6e6d2731619d req-a99c9c6b-1440-493d-b6d9-039d2972244a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bbdc2f9-9111-44ca-b51e-5af1c6069184", "name": "network-vif-deleted", "tag": "ac147de6-ab9b-409f-8399-16076fabf055"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:13.944652 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-ea6ad87d-3c65-4ab8-a415-6e6d2731619d req-a99c9c6b-1440-493d-b6d9-039d2972244a service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:13.945136 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-ea6ad87d-3c65-4ab8-a415-6e6d2731619d req-a99c9c6b-1440-493d-b6d9-039d2972244a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:13.945573 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-ea6ad87d-3c65-4ab8-a415-6e6d2731619d req-a99c9c6b-1440-493d-b6d9-039d2972244a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:13.958011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-ea6ad87d-3c65-4ab8-a415-6e6d2731619d req-a99c9c6b-1440-493d-b6d9-039d2972244a service nova] Creating event network-vif-deleted:ac147de6-ab9b-409f-8399-16076fabf055 for instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 on hv-cinder-85694 Sep 11 08:53:13.963333 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-ea6ad87d-3c65-4ab8-a415-6e6d2731619d req-a99c9c6b-1440-493d-b6d9-039d2972244a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 Sep 11 08:53:13.963937 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 381/789] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:14.181916 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8d738f4d-48db-4f57-9dee-041a601c9512 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:14.182589 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8d738f4d-48db-4f57-9dee-041a601c9512 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:14.189379 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d738f4d-48db-4f57-9dee-041a601c9512 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:14.189864 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d738f4d-48db-4f57-9dee-041a601c9512 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:14.190341 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d738f4d-48db-4f57-9dee-041a601c9512 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:14.191033 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d738f4d-48db-4f57-9dee-041a601c9512 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:14.191482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d738f4d-48db-4f57-9dee-041a601c9512 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:14.191898 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8d738f4d-48db-4f57-9dee-041a601c9512 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:14.262661 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8d738f4d-48db-4f57-9dee-041a601c9512 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:14.273423 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8d738f4d-48db-4f57-9dee-041a601c9512 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1306 microversion: 2.1 time: 0.095937 Sep 11 08:53:14.275002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 409/790] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:14 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:14.360728 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:14.361674 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:14.368296 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:14.368998 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:14.369524 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:14.370253 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:14.370606 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:14.371033 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:14.508386 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:14.517187 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:14.518775 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:14.519959 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-05268f7b-1643-4181-932e-ee7ac8f3d097 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.164649 Sep 11 08:53:14.520504 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 382/791] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:14 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:15.297303 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:15.297940 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:15.304784 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:15.305189 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:15.305622 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:15.306516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:15.306970 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:15.307423 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:15.342063 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:15.342494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:15.342944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:15.343391 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lazy-loading 'fault' on Instance uuid 9bbdc2f9-9111-44ca-b51e-5af1c6069184 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:53:15.384233 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aea4a0e0ec74c538735b890fb774b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcb554b6cf504ca9a30a1ea871364e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:15.392943 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f0cd0b60-4e24-45eb-93bd-4c4607584f12 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 200 len: 1311 microversion: 2.1 time: 0.099869 Sep 11 08:53:15.393518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 410/792] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:15 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:15.547361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:15.547980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:15.554629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:15.562130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:15.562130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:15.562130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:15.562130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:15.562556 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:15.692516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:15.700962 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:15.702472 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:15.703643 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8030eaa4-4123-41e1-92a9-0b07897a81b6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.161537 Sep 11 08:53:15.704206 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 383/793] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:15 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:16.414897 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:16.415507 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] [instance: 9bbdc2f9-9111-44ca-b51e-5af1c6069184] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:16.422389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:16.422878 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:16.423316 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:16.424020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:16.424470 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:16.424895 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:16.440584 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] HTTP exception thrown: Instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 could not be found. Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Request method failure captured: Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 HTTP/1.1 Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaCAu486B1xOWjzoN32Ui9eEOSqsCt3PPO76qh3QezPV599Kfd26fIVevOl2XWy4ljtSLDXXhbgXhEByiOZUCykRIKveORgcox18nSEtMQfNksuGMDm5LQpWcCuCK28TkehgbbHx8cYJignj8hbMDx_f29oWsYlEYPPugfePpJOGrDM Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: bcb554b6cf504ca9a30a1ea871364e3d Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:53:16.442262 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcb554b6cf504ca9a30a1ea871364e3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bcb554b6cf504ca9a30a1ea871364e3d", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: bcb554b6cf504ca9a30a1ea871364e3d Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1061498163 Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-ServerRescueNegativeTestJSON-1061498163-project Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: 2aea4a0e0ec74c538735b890fb774b14 Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1061498163-project Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 could not be found. Sep 11 08:53:16.445532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': '9bbdc2f9-9111-44ca-b51e-5af1c6069184'} Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 could not be found. Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:53:16.446461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 could not be found. Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 could not be found. Sep 11 08:53:16.447909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:16.449327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] Returning 404 to user: Instance 9bbdc2f9-9111-44ca-b51e-5af1c6069184 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:53:16.449327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-56cf1390-b678-493d-abde-ee0e472ec6b6 tempest-ServerRescueNegativeTestJSON-1061498163 tempest-ServerRescueNegativeTestJSON-1061498163-project] 10.222.0.44 "GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184" status: 404 len: 111 microversion: 2.1 time: 0.032752 Sep 11 08:53:16.449327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 411/794] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:16 2022] GET /compute/v2.1/servers/9bbdc2f9-9111-44ca-b51e-5af1c6069184 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:53:16.729290 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:16.729844 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:16.736694 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:16.737185 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:16.737622 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:16.738360 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:16.738814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:16.739240 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:16.889838 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:16.899434 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:16.900858 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:16.902610 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c3d1f2be-1473-4a94-a93a-d8d1fe456bc8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.177187 Sep 11 08:53:16.903182 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 384/795] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:16 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:17.931199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:17.931845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:17.938468 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:17.938956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:17.939389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:17.940130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:17.940539 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:17.940945 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:18.137825 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:18.146865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:18.148323 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:18.149488 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-057ab6b6-17a8-4f2c-ae1e-eac190922133 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.222214 Sep 11 08:53:18.150059 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 412/796] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:17 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:19.175648 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:19.176229 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:19.183193 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:19.184831 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:19.184831 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:19.185157 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:19.185477 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:19.185902 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:19.323763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:19.333058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:19.334756 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:19.335926 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2b82b448-01d6-43a3-b9c3-087db7b6f404 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.164337 Sep 11 08:53:19.336498 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 385/797] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:19 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:20.369131 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:20.369763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:20.388480 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:20.388976 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:20.390564 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:20.390791 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:20.391751 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:20.391751 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:20.400426 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:20.617437 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:20.624363 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:20.625715 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:20.626940 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-83473047-a441-46d1-b378-51b799031585 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.267962 Sep 11 08:53:20.627508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 413/798] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:20 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:21.654464 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:21.655137 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:21.658171 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:21.663285 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:21.663784 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:21.664214 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:21.665209 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:21.665715 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:21.666223 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:21.816566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:21.825210 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:21.826722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:21.827923 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0b6ad392-5495-43d4-9140-9e2841883ebe tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.178159 Sep 11 08:53:21.828630 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 386/799] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:21 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:22.857038 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:22.859125 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:22.870542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:22.871037 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:22.871472 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:22.872184 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:22.872627 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:22.873042 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:23.012637 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:23.020938 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:23.022412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:23.023577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5f1db5cc-8e3c-4359-b107-7db31d54e542 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.173156 Sep 11 08:53:23.024130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 414/800] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:22 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:53:24.048989 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:24.049883 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:24.056647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:24.057288 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:24.057732 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:24.058518 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:24.058979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:24.059409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:24.278400 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:24.287018 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:24.288473 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:24.289638 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-853bc1e6-b4d8-4f7b-ab20-6baee01b229c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.244649 Sep 11 08:53:24.290225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 387/801] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:24 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:25.315630 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:25.316250 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:25.323451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:25.324092 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:25.324719 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:25.325569 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:25.326278 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:25.327307 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:25.472873 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:25.482497 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:25.484506 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:25.485720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b0ad5f89-7555-4f1d-8665-8249c748493a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.174124 Sep 11 08:53:25.486355 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 415/802] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:25 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:26.518442 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:26.520847 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:26.528945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:26.529438 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:26.530782 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:26.531806 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:26.532560 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:26.533170 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:26.760306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:26.769670 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:26.771493 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:26.772911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ff22dcd1-0174-4e5a-80d5-6a1d1b563a7d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.264426 Sep 11 08:53:26.790448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 388/803] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:26 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:26.892993 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-581b8bf0-fb2e-40f0-a6cf-19fd261268ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:26.893490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-581b8bf0-fb2e-40f0-a6cf-19fd261268ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:26.905471 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-581b8bf0-fb2e-40f0-a6cf-19fd261268ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:26.905471 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-581b8bf0-fb2e-40f0-a6cf-19fd261268ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:26.905471 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-581b8bf0-fb2e-40f0-a6cf-19fd261268ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:26.905471 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-581b8bf0-fb2e-40f0-a6cf-19fd261268ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:26.905870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-581b8bf0-fb2e-40f0-a6cf-19fd261268ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:26.905870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-581b8bf0-fb2e-40f0-a6cf-19fd261268ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:26.936022 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-581b8bf0-fb2e-40f0-a6cf-19fd261268ac tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/ips" status: 200 len: 145 microversion: 2.1 time: 0.047972 Sep 11 08:53:26.946451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 416/804] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 08:53:26 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/ips => generated 145 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:27.803655 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:27.805212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:27.816042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:27.816804 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:27.817830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:27.818605 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:27.819067 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:27.819530 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:28.126323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:28.139654 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:28.145845 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:28.147094 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b436b5a6-99ad-4325-8690-05bf9b971827 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.348257 Sep 11 08:53:28.147668 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 389/805] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:27 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:28.534378 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-51a1555a-582f-4338-8ff8-5d7921ff3561 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: .version_select at 0x7fb27eae7ca0>, body: {"keypair": {"name": "tempest-keypair-500711422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvP7VI5zGbt1lhyRO+Ch58GarNIoN3NI7BCuPWlzQxGYx4msagejpIKQOFn2onqRbj5p4u5uHQGImux/cVZzbKbLyPN2OM85//Kk6K8dHqvyehDZENSq8ypuo85XFKnAQ=="}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:28.551390 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-51a1555a-582f-4338-8ff8-5d7921ff3561 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for project c0401850bdf44aaaa6c37ed752708f53. Resources: {'key_pairs'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:53:28.558621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-51a1555a-582f-4338-8ff8-5d7921ff3561 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for user c1c1de0489104713a90c59b89a284321 and project c0401850bdf44aaaa6c37ed752708f53. Resources: {'key_pairs'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:53:28.644881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-51a1555a-582f-4338-8ff8-5d7921ff3561 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.249907 Sep 11 08:53:28.645491 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 417/806] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 08:53:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:29.173981 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:29.174730 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:29.181808 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:29.182321 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:29.182753 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:29.183462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:29.183909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:29.184326 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:29.195214 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:29.358643 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:29.367478 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:29.369034 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:29.370117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5ee452e6-c2e6-4c0f-8339-96ebbe7ee3ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.201067 Sep 11 08:53:29.370731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 390/807] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:29 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:30.396922 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:30.397663 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:30.410787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:30.411380 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:30.412334 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:30.413145 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:30.413977 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:30.416080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:30.564940 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:30.573935 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:30.575425 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:30.576621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1a83acf8-1b9c-483a-8228-f35036528172 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.184002 Sep 11 08:53:30.594767 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 418/808] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:30 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:31.003332 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-641c5dc4-4b96-42f0-86bb-263499430a18 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b20eeb38-5dae-4727-b3e8-d9073e1e5545"}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:31.008421 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-641c5dc4-4b96-42f0-86bb-263499430a18 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:31.020688 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-641c5dc4-4b96-42f0-86bb-263499430a18 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:31.021912 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-641c5dc4-4b96-42f0-86bb-263499430a18 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:31.022729 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-641c5dc4-4b96-42f0-86bb-263499430a18 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:31.026384 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-641c5dc4-4b96-42f0-86bb-263499430a18 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:31.026384 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-641c5dc4-4b96-42f0-86bb-263499430a18 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:31.026384 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-641c5dc4-4b96-42f0-86bb-263499430a18 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:31.187812 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-819445538", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14f105a2-32ea-4014-a77a-841402520d71"}], "security_groups": [{"name": "tempest-securitygroup--168498129"}], "key_name": "tempest-keypair-500711422", "user_data": "}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:31.315260 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] validate_networks() for [('14f105a2-32ea-4014-a77a-841402520d71', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:53:31.752785 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:53:31.753477 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:53:31.753761 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:53:31.754187 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:53:31.754607 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:53:31.765376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:31.765859 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:31.766564 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:31.767303 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:31.767771 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:31.768227 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:31.786686 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for project c0401850bdf44aaaa6c37ed752708f53. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:53:31.790895 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for user c1c1de0489104713a90c59b89a284321 and project c0401850bdf44aaaa6c37ed752708f53. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:53:31.802665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:53:31.805030 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:53:32.013273 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-faa62bca-66ad-4774-b292-051226e4d2f6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.833063 Sep 11 08:53:32.020815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 419/809] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:53:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 11 08:53:32.020815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:32.020815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:32.028710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:32.030389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:32.030389 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:32.030948 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:32.031394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:32.031818 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:32.129945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-641c5dc4-4b96-42f0-86bb-263499430a18 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "POST /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.135566 Sep 11 08:53:32.131080 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 391/810] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:53:30 2022] POST /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:32.138183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ced6af01-bf0b-4526-9ae9-68eb733ce6c2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:32.139454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ced6af01-bf0b-4526-9ae9-68eb733ce6c2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:32.222862 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ced6af01-bf0b-4526-9ae9-68eb733ce6c2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:32.247077 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ced6af01-bf0b-4526-9ae9-68eb733ce6c2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1240 microversion: 2.1 time: 0.114724 Sep 11 08:53:32.254284 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 392/811] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:32 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1240 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:32.276406 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:32.292533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:32.295182 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:32.297483 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-507513e7-a75a-47d0-a4ba-b665b243a95e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1742 microversion: 2.20 time: 0.281148 Sep 11 08:53:32.299855 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 420/812] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:32 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1742 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:33.282728 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-130d30ed-8217-484b-a8b4-61d74c3ccaa8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:33.283779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-130d30ed-8217-484b-a8b4-61d74c3ccaa8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:33.292520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-130d30ed-8217-484b-a8b4-61d74c3ccaa8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:33.293224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-130d30ed-8217-484b-a8b4-61d74c3ccaa8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:33.293660 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-130d30ed-8217-484b-a8b4-61d74c3ccaa8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:33.294402 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-130d30ed-8217-484b-a8b4-61d74c3ccaa8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:33.294853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-130d30ed-8217-484b-a8b4-61d74c3ccaa8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:33.295995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-130d30ed-8217-484b-a8b4-61d74c3ccaa8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:33.340843 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:33.341469 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:33.348582 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:33.349065 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:33.349503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:33.350222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:33.350721 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:33.351138 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:33.369613 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-130d30ed-8217-484b-a8b4-61d74c3ccaa8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:33.378530 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-130d30ed-8217-484b-a8b4-61d74c3ccaa8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1244 microversion: 2.1 time: 0.101279 Sep 11 08:53:33.379174 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 393/813] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:33 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:33.501495 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:33.509856 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:33.511409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:33.512601 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1160b077-c5eb-464c-99c3-4ea1797d57a9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1742 microversion: 2.20 time: 0.175656 Sep 11 08:53:33.513161 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 421/814] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:33 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1742 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:53:34.403291 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8019bea6-fa18-4968-ab52-d6d1288b49a5 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:34.404072 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8019bea6-fa18-4968-ab52-d6d1288b49a5 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:34.420580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8019bea6-fa18-4968-ab52-d6d1288b49a5 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:34.421159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8019bea6-fa18-4968-ab52-d6d1288b49a5 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:34.421605 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8019bea6-fa18-4968-ab52-d6d1288b49a5 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:34.422529 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8019bea6-fa18-4968-ab52-d6d1288b49a5 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:34.423153 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8019bea6-fa18-4968-ab52-d6d1288b49a5 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:34.424360 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8019bea6-fa18-4968-ab52-d6d1288b49a5 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:34.506485 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8019bea6-fa18-4968-ab52-d6d1288b49a5 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:34.517084 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8019bea6-fa18-4968-ab52-d6d1288b49a5 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1292 microversion: 2.1 time: 0.118898 Sep 11 08:53:34.517500 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 394/815] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:34 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1292 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:34.540260 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:34.541633 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:34.585459 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:34.593192 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:34.594088 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:34.596396 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:34.596898 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:34.597329 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:35.130808 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:35.139800 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:35.141455 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:35.142712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7ae72121-fcb5-4dec-93a5-23eae2b87e37 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1737 microversion: 2.20 time: 0.606976 Sep 11 08:53:35.143468 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 422/816] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:34 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1737 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:35.412146 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f161b320-f671-4359-817c-f45cbe351270 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:35.412797 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f161b320-f671-4359-817c-f45cbe351270 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:35.424300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f161b320-f671-4359-817c-f45cbe351270 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:35.424931 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f161b320-f671-4359-817c-f45cbe351270 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:35.425590 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f161b320-f671-4359-817c-f45cbe351270 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:35.426374 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f161b320-f671-4359-817c-f45cbe351270 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:35.427144 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f161b320-f671-4359-817c-f45cbe351270 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:35.432472 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f161b320-f671-4359-817c-f45cbe351270 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:35.542423 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7415d24e-182c-43ac-a80e-d58b2b843396 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:35.543046 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7415d24e-182c-43ac-a80e-d58b2b843396 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:35.555190 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7415d24e-182c-43ac-a80e-d58b2b843396 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:35.557293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7415d24e-182c-43ac-a80e-d58b2b843396 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:35.557991 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7415d24e-182c-43ac-a80e-d58b2b843396 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:35.558790 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7415d24e-182c-43ac-a80e-d58b2b843396 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:35.559257 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7415d24e-182c-43ac-a80e-d58b2b843396 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:35.559682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7415d24e-182c-43ac-a80e-d58b2b843396 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:35.567481 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-f161b320-f671-4359-817c-f45cbe351270 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lazy-loading 'services' on Instance uuid d0886581-401f-4faa-ac8b-1a5982e4f42c {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:53:35.691259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7415d24e-182c-43ac-a80e-d58b2b843396 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:35.699813 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7415d24e-182c-43ac-a80e-d58b2b843396 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1298 microversion: 2.1 time: 0.161262 Sep 11 08:53:35.701118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 423/817] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:35 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1298 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:35.815815 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f161b320-f671-4359-817c-f45cbe351270 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c/os-volume_attachments/e27a884a-a995-43c3-ab91-a1845f6196e5" status: 202 len: 0 microversion: 2.1 time: 0.407188 Sep 11 08:53:35.816997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 395/818] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:53:35 2022] DELETE /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c/os-volume_attachments/e27a884a-a995-43c3-ab91-a1845f6196e5 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:53:36.173944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:36.174597 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:36.183827 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:36.184330 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:36.184770 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:36.186012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:36.186680 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:36.187269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:36.362479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:36.380866 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:36.380866 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:36.383263 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d2864a3b-8b4c-4f4a-82b8-67c6ea4764e2 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1737 microversion: 2.20 time: 0.214162 Sep 11 08:53:36.398837 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 424/819] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:36 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:36.728671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-848c8917-83b0-4646-80e3-5aafdb368b3c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:36.731523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-848c8917-83b0-4646-80e3-5aafdb368b3c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:36.748026 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-848c8917-83b0-4646-80e3-5aafdb368b3c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:36.749357 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-848c8917-83b0-4646-80e3-5aafdb368b3c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:36.749974 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-848c8917-83b0-4646-80e3-5aafdb368b3c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:36.751283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-848c8917-83b0-4646-80e3-5aafdb368b3c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:36.752026 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-848c8917-83b0-4646-80e3-5aafdb368b3c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:36.752635 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-848c8917-83b0-4646-80e3-5aafdb368b3c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:36.782313 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-d5f29b05-8f97-44e5-ae8a-614a7ebce4a1 req-6ca9cd7b-3271-44f1-bc1c-0a99f5d75ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe", "name": "network-vif-plugged", "status": "completed", "tag": "2a26af6d-2714-450a-b99a-6e72dec54d7e"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:36.811913 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d5f29b05-8f97-44e5-ae8a-614a7ebce4a1 req-6ca9cd7b-3271-44f1-bc1c-0a99f5d75ac3 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:36.812753 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d5f29b05-8f97-44e5-ae8a-614a7ebce4a1 req-6ca9cd7b-3271-44f1-bc1c-0a99f5d75ac3 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:36.813357 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d5f29b05-8f97-44e5-ae8a-614a7ebce4a1 req-6ca9cd7b-3271-44f1-bc1c-0a99f5d75ac3 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:36.826668 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-d5f29b05-8f97-44e5-ae8a-614a7ebce4a1 req-6ca9cd7b-3271-44f1-bc1c-0a99f5d75ac3 service nova] Creating event network-vif-plugged:2a26af6d-2714-450a-b99a-6e72dec54d7e for instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe on hv-cinder-85694 Sep 11 08:53:36.832363 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-d5f29b05-8f97-44e5-ae8a-614a7ebce4a1 req-6ca9cd7b-3271-44f1-bc1c-0a99f5d75ac3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054358 Sep 11 08:53:36.833568 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 425/820] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:53:37.014852 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-848c8917-83b0-4646-80e3-5aafdb368b3c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:37.028190 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-848c8917-83b0-4646-80e3-5aafdb368b3c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1365 microversion: 2.1 time: 0.305472 Sep 11 08:53:37.033548 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 396/821] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:36 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:37.412936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:37.413852 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:37.420728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:37.425134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:37.425134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:37.425134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:37.425134 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:37.425519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:37.490436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-cb050caa-2c4d-4b1e-ba22-dbf720b222be req-e659c02f-856e-4fcb-bb57-d2cceb152983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5fbae7-a31c-412a-997f-365bb68b7ea6", "tag": "5e23f4a5-938f-4956-9719-ad21eb95651c"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:37.500995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-cb050caa-2c4d-4b1e-ba22-dbf720b222be req-e659c02f-856e-4fcb-bb57-d2cceb152983 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:37.501783 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-cb050caa-2c4d-4b1e-ba22-dbf720b222be req-e659c02f-856e-4fcb-bb57-d2cceb152983 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:37.502392 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-cb050caa-2c4d-4b1e-ba22-dbf720b222be req-e659c02f-856e-4fcb-bb57-d2cceb152983 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:37.520091 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-cb050caa-2c4d-4b1e-ba22-dbf720b222be req-e659c02f-856e-4fcb-bb57-d2cceb152983 service nova] Creating event network-changed:5e23f4a5-938f-4956-9719-ad21eb95651c for instance be5fbae7-a31c-412a-997f-365bb68b7ea6 on hv-cinder-85694 Sep 11 08:53:37.525409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-cb050caa-2c4d-4b1e-ba22-dbf720b222be req-e659c02f-856e-4fcb-bb57-d2cceb152983 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038876 Sep 11 08:53:37.526273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 397/822] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:53:37.681897 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:37.693222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:37.695693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:37.698240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-89b4cfb7-fd43-47bd-abe0-eca9498cfa78 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1737 microversion: 2.20 time: 0.290080 Sep 11 08:53:37.699167 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 426/823] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:37 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1737 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:38.060204 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-81fd2428-3a27-4551-adab-fd7085386f4e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:38.061382 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-81fd2428-3a27-4551-adab-fd7085386f4e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:38.072178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd2428-3a27-4551-adab-fd7085386f4e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:38.072178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd2428-3a27-4551-adab-fd7085386f4e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:38.072178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd2428-3a27-4551-adab-fd7085386f4e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:38.072178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd2428-3a27-4551-adab-fd7085386f4e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:38.072525 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd2428-3a27-4551-adab-fd7085386f4e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:38.072525 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd2428-3a27-4551-adab-fd7085386f4e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:38.208362 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-81fd2428-3a27-4551-adab-fd7085386f4e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:38.215994 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-81fd2428-3a27-4551-adab-fd7085386f4e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1365 microversion: 2.1 time: 0.161079 Sep 11 08:53:38.216676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 398/824] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:38 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:38.725195 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:38.725979 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:38.759386 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:38.760197 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:38.760798 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:38.761729 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:38.762390 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:38.762824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:38.951891 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:38.961847 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:38.963673 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:38.965129 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3b56a471-ac32-42d7-9aa7-efec012038b0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1737 microversion: 2.20 time: 0.243992 Sep 11 08:53:38.968545 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 427/825] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:38 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:39.240748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c6f78161-67f2-4c89-9ce3-485fdb668937 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:39.242449 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c6f78161-67f2-4c89-9ce3-485fdb668937 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:39.250537 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6f78161-67f2-4c89-9ce3-485fdb668937 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:39.251755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6f78161-67f2-4c89-9ce3-485fdb668937 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:39.252284 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6f78161-67f2-4c89-9ce3-485fdb668937 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:39.253916 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6f78161-67f2-4c89-9ce3-485fdb668937 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:39.255186 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6f78161-67f2-4c89-9ce3-485fdb668937 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:39.255977 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6f78161-67f2-4c89-9ce3-485fdb668937 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:39.410620 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c6f78161-67f2-4c89-9ce3-485fdb668937 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:39.419517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c6f78161-67f2-4c89-9ce3-485fdb668937 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1365 microversion: 2.1 time: 0.183820 Sep 11 08:53:39.420679 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 399/826] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:39 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:39.997077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:39.997812 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:40.008099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:40.011143 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:40.011143 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:40.011143 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:40.011143 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:40.011547 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:40.165453 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:40.177253 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:40.178812 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:40.183562 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-89ca24d8-8e85-44b4-8bbd-168f2d2317fc tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1737 microversion: 2.20 time: 0.190284 Sep 11 08:53:40.185356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 428/827] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:39 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:40.370326 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b6d1074b-876d-4aaf-83b3-302a2f69cc3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:40.370987 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b6d1074b-876d-4aaf-83b3-302a2f69cc3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:40.380763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6d1074b-876d-4aaf-83b3-302a2f69cc3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:40.382356 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6d1074b-876d-4aaf-83b3-302a2f69cc3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:40.382356 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6d1074b-876d-4aaf-83b3-302a2f69cc3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:40.382636 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6d1074b-876d-4aaf-83b3-302a2f69cc3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:40.383038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6d1074b-876d-4aaf-83b3-302a2f69cc3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:40.383675 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6d1074b-876d-4aaf-83b3-302a2f69cc3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:40.418015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-b6d1074b-876d-4aaf-83b3-302a2f69cc3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lazy-loading 'flavor' on Instance uuid 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:53:40.444666 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-70a6df0b-984e-4473-9106-a76a8d5e5377 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:40.445334 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-70a6df0b-984e-4473-9106-a76a8d5e5377 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:40.452286 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:40.454070 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-70a6df0b-984e-4473-9106-a76a8d5e5377 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:40.454619 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-70a6df0b-984e-4473-9106-a76a8d5e5377 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:40.455059 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-70a6df0b-984e-4473-9106-a76a8d5e5377 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:40.455767 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-70a6df0b-984e-4473-9106-a76a8d5e5377 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:40.456228 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-70a6df0b-984e-4473-9106-a76a8d5e5377 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:40.456692 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-70a6df0b-984e-4473-9106-a76a8d5e5377 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:40.651800 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-70a6df0b-984e-4473-9106-a76a8d5e5377 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:40.660950 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-70a6df0b-984e-4473-9106-a76a8d5e5377 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1365 microversion: 2.1 time: 0.221450 Sep 11 08:53:40.661536 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 429/828] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:40 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:40.804297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b6d1074b-876d-4aaf-83b3-302a2f69cc3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "POST /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b/action" status: 202 len: 0 microversion: 2.1 time: 0.437895 Sep 11 08:53:40.805329 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 400/829] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:53:40 2022] POST /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:53:40.814689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8b1d8443-2a96-4118-aa17-25e01f8eac9f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:40.815366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8b1d8443-2a96-4118-aa17-25e01f8eac9f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:40.821694 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b1d8443-2a96-4118-aa17-25e01f8eac9f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:40.821857 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b1d8443-2a96-4118-aa17-25e01f8eac9f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:40.822314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b1d8443-2a96-4118-aa17-25e01f8eac9f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:40.823031 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b1d8443-2a96-4118-aa17-25e01f8eac9f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:40.823465 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b1d8443-2a96-4118-aa17-25e01f8eac9f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:40.823889 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-8b1d8443-2a96-4118-aa17-25e01f8eac9f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:40.997525 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8b1d8443-2a96-4118-aa17-25e01f8eac9f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:41.015299 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8b1d8443-2a96-4118-aa17-25e01f8eac9f tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.205369 Sep 11 08:53:41.015885 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 430/830] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:40 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:41.052055 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8ccd6c38-3a51-4b53-9659-dc2da25972de tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:41.055355 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8ccd6c38-3a51-4b53-9659-dc2da25972de tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:41.067428 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8ccd6c38-3a51-4b53-9659-dc2da25972de tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:41.068275 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8ccd6c38-3a51-4b53-9659-dc2da25972de tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:41.068969 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8ccd6c38-3a51-4b53-9659-dc2da25972de tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:41.069920 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8ccd6c38-3a51-4b53-9659-dc2da25972de tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:41.070404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8ccd6c38-3a51-4b53-9659-dc2da25972de tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:41.070933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8ccd6c38-3a51-4b53-9659-dc2da25972de tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:41.107010 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8ccd6c38-3a51-4b53-9659-dc2da25972de tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059705 Sep 11 08:53:41.111962 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 401/831] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:53:41 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:41.121895 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-894dbdaa-6e42-44ac-b89a-b3c6be1c02c7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:41.122413 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-894dbdaa-6e42-44ac-b89a-b3c6be1c02c7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:41.131089 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-894dbdaa-6e42-44ac-b89a-b3c6be1c02c7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:41.131972 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-894dbdaa-6e42-44ac-b89a-b3c6be1c02c7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:41.132890 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-894dbdaa-6e42-44ac-b89a-b3c6be1c02c7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:41.133982 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-894dbdaa-6e42-44ac-b89a-b3c6be1c02c7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:41.134828 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-894dbdaa-6e42-44ac-b89a-b3c6be1c02c7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:41.135423 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-894dbdaa-6e42-44ac-b89a-b3c6be1c02c7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:41.168186 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-894dbdaa-6e42-44ac-b89a-b3c6be1c02c7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments/b20eeb38-5dae-4727-b3e8-d9073e1e5545" status: 200 len: 194 microversion: 2.1 time: 0.050218 Sep 11 08:53:41.169010 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 431/832] 10.222.0.44 () {58 vars in 1413 bytes} [Sun Sep 11 08:53:41 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments/b20eeb38-5dae-4727-b3e8-d9073e1e5545 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:41.211409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:41.211911 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:41.220542 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:41.220542 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:41.220542 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:41.220542 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:41.220993 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:41.220993 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:41.412112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:41.422724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:41.424080 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:41.425434 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-41e887bd-1b5b-42be-b035-9660d70a05b7 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1737 microversion: 2.20 time: 0.218056 Sep 11 08:53:41.426007 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 402/833] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:41 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:41.686414 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1ae395c6-7e24-4364-a23b-01773400591e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:41.687077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1ae395c6-7e24-4364-a23b-01773400591e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:41.693439 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ae395c6-7e24-4364-a23b-01773400591e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:41.693941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ae395c6-7e24-4364-a23b-01773400591e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:41.694521 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ae395c6-7e24-4364-a23b-01773400591e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:41.695339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ae395c6-7e24-4364-a23b-01773400591e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:41.695918 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ae395c6-7e24-4364-a23b-01773400591e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:41.696279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1ae395c6-7e24-4364-a23b-01773400591e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:41.712117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:41.775515 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:41.797368 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=10 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:41.839028 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1ae395c6-7e24-4364-a23b-01773400591e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:41.849217 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1ae395c6-7e24-4364-a23b-01773400591e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1365 microversion: 2.1 time: 0.166906 Sep 11 08:53:41.849801 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 432/834] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:41 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:42.044165 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f5d16606-0842-46bc-b98b-614a32a29db8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:42.044767 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f5d16606-0842-46bc-b98b-614a32a29db8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:42.050889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5d16606-0842-46bc-b98b-614a32a29db8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:42.051375 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5d16606-0842-46bc-b98b-614a32a29db8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:42.051805 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5d16606-0842-46bc-b98b-614a32a29db8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:42.052503 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5d16606-0842-46bc-b98b-614a32a29db8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:42.052953 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5d16606-0842-46bc-b98b-614a32a29db8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:42.053379 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f5d16606-0842-46bc-b98b-614a32a29db8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:42.201897 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f5d16606-0842-46bc-b98b-614a32a29db8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:42.210390 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f5d16606-0842-46bc-b98b-614a32a29db8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.170324 Sep 11 08:53:42.210971 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 403/835] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:42 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:42.425798 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-635378ba-f862-4810-9c3f-af2638e18992 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:42.426621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-635378ba-f862-4810-9c3f-af2638e18992 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:42.447312 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-635378ba-f862-4810-9c3f-af2638e18992 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:42.448204 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-635378ba-f862-4810-9c3f-af2638e18992 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:42.449006 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-635378ba-f862-4810-9c3f-af2638e18992 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:42.449970 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-635378ba-f862-4810-9c3f-af2638e18992 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:42.450686 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-635378ba-f862-4810-9c3f-af2638e18992 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:42.451884 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-635378ba-f862-4810-9c3f-af2638e18992 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:42.456510 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:42.457830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:42.463909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:42.479101 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:42.479623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:42.480029 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:42.480740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:42.481200 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:42.481451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-635378ba-f862-4810-9c3f-af2638e18992 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Going to try to terminate instance {{(pid=127646) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:53:42.481617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:42.532301 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:42.682004 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:42.693788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:42.696060 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:42.698269 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b5983950-d658-495a-8f20-ba9ec7fd3eaf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1737 microversion: 2.20 time: 0.249671 Sep 11 08:53:42.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 404/836] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:42 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:42.862598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-635378ba-f862-4810-9c3f-af2638e18992 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 204 len: 0 microversion: 2.1 time: 0.442739 Sep 11 08:53:42.873627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c96a19bf-36f4-48e4-a41d-7392e09e6003 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:42.874416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 433/837] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:53:42 2022] DELETE /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:53:42.879515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c96a19bf-36f4-48e4-a41d-7392e09e6003 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:42.883618 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-17e1bf7c-b39b-4b20-bfe8-8a4ff0287ba0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:42.891974 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-17e1bf7c-b39b-4b20-bfe8-8a4ff0287ba0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:42.899238 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c96a19bf-36f4-48e4-a41d-7392e09e6003 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:42.900096 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c96a19bf-36f4-48e4-a41d-7392e09e6003 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:42.900725 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c96a19bf-36f4-48e4-a41d-7392e09e6003 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:42.901777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c96a19bf-36f4-48e4-a41d-7392e09e6003 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:42.902424 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c96a19bf-36f4-48e4-a41d-7392e09e6003 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:42.903012 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c96a19bf-36f4-48e4-a41d-7392e09e6003 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:42.905859 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e1bf7c-b39b-4b20-bfe8-8a4ff0287ba0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:42.909238 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e1bf7c-b39b-4b20-bfe8-8a4ff0287ba0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:42.909935 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e1bf7c-b39b-4b20-bfe8-8a4ff0287ba0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:42.910719 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e1bf7c-b39b-4b20-bfe8-8a4ff0287ba0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:42.912285 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e1bf7c-b39b-4b20-bfe8-8a4ff0287ba0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:42.913037 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-17e1bf7c-b39b-4b20-bfe8-8a4ff0287ba0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:43.112150 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c96a19bf-36f4-48e4-a41d-7392e09e6003 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:43.123448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c96a19bf-36f4-48e4-a41d-7392e09e6003 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1365 microversion: 2.1 time: 0.254104 Sep 11 08:53:43.140669 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 405/838] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:42 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:43.141005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-17e1bf7c-b39b-4b20-bfe8-8a4ff0287ba0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:43.153788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-17e1bf7c-b39b-4b20-bfe8-8a4ff0287ba0 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1515 microversion: 2.1 time: 0.277411 Sep 11 08:53:43.170236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 434/839] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:42 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1515 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:43.236188 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e9d4a858-944e-4fba-8e93-c3679782aae0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:43.236926 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e9d4a858-944e-4fba-8e93-c3679782aae0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:43.243985 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e9d4a858-944e-4fba-8e93-c3679782aae0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:43.244934 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e9d4a858-944e-4fba-8e93-c3679782aae0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:43.245579 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e9d4a858-944e-4fba-8e93-c3679782aae0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:43.246555 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e9d4a858-944e-4fba-8e93-c3679782aae0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:43.247273 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e9d4a858-944e-4fba-8e93-c3679782aae0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:43.248180 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e9d4a858-944e-4fba-8e93-c3679782aae0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:43.421891 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6d86b27d-d07b-46e2-b255-2a0f44cc3aa7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed2a0955-3c31-4ca1-88ae-11f7b361954a"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:43.425642 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6d86b27d-d07b-46e2-b255-2a0f44cc3aa7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:43.434319 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6d86b27d-d07b-46e2-b255-2a0f44cc3aa7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:43.438404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6d86b27d-d07b-46e2-b255-2a0f44cc3aa7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:43.438404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6d86b27d-d07b-46e2-b255-2a0f44cc3aa7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:43.438404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6d86b27d-d07b-46e2-b255-2a0f44cc3aa7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:43.438404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6d86b27d-d07b-46e2-b255-2a0f44cc3aa7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:43.438793 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6d86b27d-d07b-46e2-b255-2a0f44cc3aa7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:43.447236 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e9d4a858-944e-4fba-8e93-c3679782aae0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:43.456643 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e9d4a858-944e-4fba-8e93-c3679782aae0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.225689 Sep 11 08:53:43.462679 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 406/840] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:43 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:43.727547 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:43.728462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:43.735783 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:43.736586 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:43.737783 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:43.738801 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:43.739425 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:43.739997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:43.890929 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:43.899506 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:43.900961 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:43.902193 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-7db3ac1a-abf1-4fea-a284-0a919c0ca323 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1737 microversion: 2.20 time: 0.178998 Sep 11 08:53:43.902748 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 407/841] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:43 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:53:44.146078 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5a99c2b6-5784-42de-a894-0017e6a07576 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:44.147118 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5a99c2b6-5784-42de-a894-0017e6a07576 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:44.154328 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5a99c2b6-5784-42de-a894-0017e6a07576 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:44.155103 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5a99c2b6-5784-42de-a894-0017e6a07576 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:44.155838 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5a99c2b6-5784-42de-a894-0017e6a07576 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:44.156492 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5a99c2b6-5784-42de-a894-0017e6a07576 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:44.156952 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5a99c2b6-5784-42de-a894-0017e6a07576 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:44.157383 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5a99c2b6-5784-42de-a894-0017e6a07576 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:44.322710 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5a99c2b6-5784-42de-a894-0017e6a07576 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:44.331792 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5a99c2b6-5784-42de-a894-0017e6a07576 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1365 microversion: 2.1 time: 0.189523 Sep 11 08:53:44.347032 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 408/842] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:44 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:44.356188 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ffa268c9-ed7a-4a7e-8c0f-f5fc291cacd4 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:44.357120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ffa268c9-ed7a-4a7e-8c0f-f5fc291cacd4 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:44.364070 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffa268c9-ed7a-4a7e-8c0f-f5fc291cacd4 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:44.364569 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffa268c9-ed7a-4a7e-8c0f-f5fc291cacd4 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:44.365009 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffa268c9-ed7a-4a7e-8c0f-f5fc291cacd4 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:44.365711 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffa268c9-ed7a-4a7e-8c0f-f5fc291cacd4 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:44.366183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffa268c9-ed7a-4a7e-8c0f-f5fc291cacd4 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:44.366622 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffa268c9-ed7a-4a7e-8c0f-f5fc291cacd4 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:44.524709 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ffa268c9-ed7a-4a7e-8c0f-f5fc291cacd4 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:44.535264 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ffa268c9-ed7a-4a7e-8c0f-f5fc291cacd4 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1515 microversion: 2.1 time: 0.186959 Sep 11 08:53:44.535852 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 409/843] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:44 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:44.541512 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1feef07a-10de-44fe-84c8-276cf1a8da3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:44.542158 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1feef07a-10de-44fe-84c8-276cf1a8da3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:44.550121 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1feef07a-10de-44fe-84c8-276cf1a8da3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:44.550737 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1feef07a-10de-44fe-84c8-276cf1a8da3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:44.551171 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1feef07a-10de-44fe-84c8-276cf1a8da3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:44.551877 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1feef07a-10de-44fe-84c8-276cf1a8da3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:44.552327 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1feef07a-10de-44fe-84c8-276cf1a8da3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:44.552763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1feef07a-10de-44fe-84c8-276cf1a8da3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:44.723431 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1feef07a-10de-44fe-84c8-276cf1a8da3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:44.736042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1feef07a-10de-44fe-84c8-276cf1a8da3e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.198933 Sep 11 08:53:44.737320 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 410/844] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:44 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:44.860052 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-f95f8910-f510-436f-89f1-dd1351240681 req-4cfabade-ea59-4dcb-beed-25915241119f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5fbae7-a31c-412a-997f-365bb68b7ea6", "name": "network-vif-plugged", "status": "completed", "tag": "5e23f4a5-938f-4956-9719-ad21eb95651c"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:44.876842 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-f95f8910-f510-436f-89f1-dd1351240681 req-4cfabade-ea59-4dcb-beed-25915241119f service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:44.877336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-f95f8910-f510-436f-89f1-dd1351240681 req-4cfabade-ea59-4dcb-beed-25915241119f service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:44.884320 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-f95f8910-f510-436f-89f1-dd1351240681 req-4cfabade-ea59-4dcb-beed-25915241119f service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:44.898539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-f95f8910-f510-436f-89f1-dd1351240681 req-4cfabade-ea59-4dcb-beed-25915241119f service nova] Creating event network-vif-plugged:5e23f4a5-938f-4956-9719-ad21eb95651c for instance be5fbae7-a31c-412a-997f-365bb68b7ea6 on hv-cinder-85694 Sep 11 08:53:44.904806 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-f95f8910-f510-436f-89f1-dd1351240681 req-4cfabade-ea59-4dcb-beed-25915241119f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049057 Sep 11 08:53:44.905410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 411/845] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:53:44.932266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:44.933263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:44.945227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:44.945672 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:44.946891 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:44.948254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:44.948912 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:44.954037 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:45.131029 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:45.143284 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:45.144993 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:45.146404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2bfe7e6c-8aaf-4044-a33a-4d71d6e37a16 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1737 microversion: 2.20 time: 0.218558 Sep 11 08:53:45.147274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 412/846] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:44 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:45.365939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b86f5f06-86ed-4a52-af5f-91b4cfeeb330 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:45.366740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b86f5f06-86ed-4a52-af5f-91b4cfeeb330 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:45.376205 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b86f5f06-86ed-4a52-af5f-91b4cfeeb330 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:45.377325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b86f5f06-86ed-4a52-af5f-91b4cfeeb330 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:45.377856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b86f5f06-86ed-4a52-af5f-91b4cfeeb330 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:45.378723 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b86f5f06-86ed-4a52-af5f-91b4cfeeb330 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:45.384491 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b86f5f06-86ed-4a52-af5f-91b4cfeeb330 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:45.384491 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b86f5f06-86ed-4a52-af5f-91b4cfeeb330 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:45.523404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6d86b27d-d07b-46e2-b255-2a0f44cc3aa7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "POST /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.107718 Sep 11 08:53:45.524461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 435/847] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:53:43 2022] POST /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments => generated 194 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:45.566364 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7cd995c8-5c6a-4f81-b93a-e31369f9bfcb tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:45.567728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7cd995c8-5c6a-4f81-b93a-e31369f9bfcb tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:45.573922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b86f5f06-86ed-4a52-af5f-91b4cfeeb330 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:45.580786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cd995c8-5c6a-4f81-b93a-e31369f9bfcb tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:45.580786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cd995c8-5c6a-4f81-b93a-e31369f9bfcb tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:45.580786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cd995c8-5c6a-4f81-b93a-e31369f9bfcb tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:45.580786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cd995c8-5c6a-4f81-b93a-e31369f9bfcb tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:45.581530 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cd995c8-5c6a-4f81-b93a-e31369f9bfcb tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:45.582018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7cd995c8-5c6a-4f81-b93a-e31369f9bfcb tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:45.588788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b86f5f06-86ed-4a52-af5f-91b4cfeeb330 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1365 microversion: 2.1 time: 0.230906 Sep 11 08:53:45.589693 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 413/848] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:45 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:45.744412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7cd995c8-5c6a-4f81-b93a-e31369f9bfcb tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:45.752810 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7cd995c8-5c6a-4f81-b93a-e31369f9bfcb tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1515 microversion: 2.1 time: 0.195109 Sep 11 08:53:45.753376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 436/849] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:45 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:45.776955 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-433a129b-4e97-46c3-92c3-25595b41d7c3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:45.778031 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-433a129b-4e97-46c3-92c3-25595b41d7c3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:45.791019 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-433a129b-4e97-46c3-92c3-25595b41d7c3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:45.791606 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-433a129b-4e97-46c3-92c3-25595b41d7c3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:45.792076 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-433a129b-4e97-46c3-92c3-25595b41d7c3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:45.792875 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-433a129b-4e97-46c3-92c3-25595b41d7c3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:45.793379 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-433a129b-4e97-46c3-92c3-25595b41d7c3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:45.793799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-433a129b-4e97-46c3-92c3-25595b41d7c3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:45.964847 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-433a129b-4e97-46c3-92c3-25595b41d7c3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:45.974058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-433a129b-4e97-46c3-92c3-25595b41d7c3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.201084 Sep 11 08:53:45.977564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 414/850] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:45 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:46.009781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-8c0fd9d8-4a40-4b17-87a8-44acc3f7a3b2 req-3978b11c-d3e3-445f-8e59-e778a63d327a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0886581-401f-4faa-ac8b-1a5982e4f42c", "name": "network-vif-deleted", "tag": "596c3071-5314-4f5b-860c-696e06936266"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:46.024648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-8c0fd9d8-4a40-4b17-87a8-44acc3f7a3b2 req-3978b11c-d3e3-445f-8e59-e778a63d327a service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:46.025942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-8c0fd9d8-4a40-4b17-87a8-44acc3f7a3b2 req-3978b11c-d3e3-445f-8e59-e778a63d327a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:46.026395 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-8c0fd9d8-4a40-4b17-87a8-44acc3f7a3b2 req-3978b11c-d3e3-445f-8e59-e778a63d327a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:46.040845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-8c0fd9d8-4a40-4b17-87a8-44acc3f7a3b2 req-3978b11c-d3e3-445f-8e59-e778a63d327a service nova] Creating event network-vif-deleted:596c3071-5314-4f5b-860c-696e06936266 for instance d0886581-401f-4faa-ac8b-1a5982e4f42c on hv-cinder-85694 Sep 11 08:53:46.047034 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-8c0fd9d8-4a40-4b17-87a8-44acc3f7a3b2 req-3978b11c-d3e3-445f-8e59-e778a63d327a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040787 Sep 11 08:53:46.047801 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 437/851] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:46.177341 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:46.178406 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:46.185010 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:46.186010 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:46.186480 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:46.187193 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:46.187648 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:46.188076 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:46.360730 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:46.375301 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:46.378168 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:46.379623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f3759bc1-6ce0-4195-a964-13f1bd1c04a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1737 microversion: 2.20 time: 0.206343 Sep 11 08:53:46.380749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 415/852] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:46 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:46.614981 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c4dff80f-0dd4-4a2f-96b6-d7ca340442b8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:46.615726 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c4dff80f-0dd4-4a2f-96b6-d7ca340442b8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:46.636502 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c4dff80f-0dd4-4a2f-96b6-d7ca340442b8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:46.636884 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c4dff80f-0dd4-4a2f-96b6-d7ca340442b8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:46.641121 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c4dff80f-0dd4-4a2f-96b6-d7ca340442b8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:46.642095 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c4dff80f-0dd4-4a2f-96b6-d7ca340442b8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:46.642748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c4dff80f-0dd4-4a2f-96b6-d7ca340442b8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:46.643637 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c4dff80f-0dd4-4a2f-96b6-d7ca340442b8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:46.776700 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:46.777336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:46.784129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:46.784618 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:46.785226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:46.786137 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:46.786436 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:46.787040 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:46.820895 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:46.821383 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:46.821823 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:46.822304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lazy-loading 'fault' on Instance uuid d0886581-401f-4faa-ac8b-1a5982e4f42c {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:53:46.830822 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c4dff80f-0dd4-4a2f-96b6-d7ca340442b8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:46.846372 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c4dff80f-0dd4-4a2f-96b6-d7ca340442b8 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1365 microversion: 2.1 time: 0.236509 Sep 11 08:53:46.847181 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 438/853] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:46 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:46.869324 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:46.877674 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a8f58a60-d645-4e8b-97be-4ab8e6cdb6dc tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1309 microversion: 2.1 time: 0.105380 Sep 11 08:53:46.878386 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 416/854] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:46 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:47.000089 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-add9e38b-871a-4337-bdb5-62c97bb282a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:47.000713 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-add9e38b-871a-4337-bdb5-62c97bb282a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:47.006716 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-add9e38b-871a-4337-bdb5-62c97bb282a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:47.007194 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-add9e38b-871a-4337-bdb5-62c97bb282a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:47.012951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-add9e38b-871a-4337-bdb5-62c97bb282a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:47.012951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-add9e38b-871a-4337-bdb5-62c97bb282a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:47.012951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-add9e38b-871a-4337-bdb5-62c97bb282a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:47.012951 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-add9e38b-871a-4337-bdb5-62c97bb282a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:47.152333 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-add9e38b-871a-4337-bdb5-62c97bb282a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:47.161247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-add9e38b-871a-4337-bdb5-62c97bb282a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.164933 Sep 11 08:53:47.161826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 439/855] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:46 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:47.406568 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:47.407283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:47.414044 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:47.414601 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:47.415173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:47.415885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:47.416341 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:47.416769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:47.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:47.573543 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:47.575027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:47.576853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-508becb0-a039-4c1f-aba9-27dcbdd75231 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1737 microversion: 2.20 time: 0.174226 Sep 11 08:53:47.577427 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 417/856] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:47 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:47.870402 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ba05b9dc-28f6-4fc5-94ec-3db03c091f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:47.871053 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ba05b9dc-28f6-4fc5-94ec-3db03c091f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:47.877949 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba05b9dc-28f6-4fc5-94ec-3db03c091f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:47.878476 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba05b9dc-28f6-4fc5-94ec-3db03c091f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:47.878921 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba05b9dc-28f6-4fc5-94ec-3db03c091f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:47.879627 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba05b9dc-28f6-4fc5-94ec-3db03c091f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:47.880086 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba05b9dc-28f6-4fc5-94ec-3db03c091f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:47.880506 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ba05b9dc-28f6-4fc5-94ec-3db03c091f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:47.906184 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:47.906903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:47.913088 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:47.913574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:47.914006 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:47.914742 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:47.915191 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:47.915609 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:47.953373 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:47.953898 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:47.954325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:47.954772 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lazy-loading 'fault' on Instance uuid d0886581-401f-4faa-ac8b-1a5982e4f42c {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:53:48.009016 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bae09cfbf3844b1682d8924e7d9578ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94ceae42bd11404eaea28d523b98126e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:48.017802 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-39398bdf-ecdb-4030-9f28-f36ffe5ed367 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 200 len: 1309 microversion: 2.1 time: 0.115555 Sep 11 08:53:48.018435 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 418/857] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:47 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:48.032005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ba05b9dc-28f6-4fc5-94ec-3db03c091f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:48.040602 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ba05b9dc-28f6-4fc5-94ec-3db03c091f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1555 microversion: 2.1 time: 0.174061 Sep 11 08:53:48.041196 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 440/858] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:47 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:48.068806 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-abbea2ee-b85c-4a9f-97a1-81a9aed4d710 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:48.069859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-abbea2ee-b85c-4a9f-97a1-81a9aed4d710 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:48.079232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abbea2ee-b85c-4a9f-97a1-81a9aed4d710 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:48.079945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abbea2ee-b85c-4a9f-97a1-81a9aed4d710 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:48.080945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abbea2ee-b85c-4a9f-97a1-81a9aed4d710 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:48.081220 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abbea2ee-b85c-4a9f-97a1-81a9aed4d710 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:48.081604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abbea2ee-b85c-4a9f-97a1-81a9aed4d710 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:48.082030 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abbea2ee-b85c-4a9f-97a1-81a9aed4d710 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:48.179920 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-abbea2ee-b85c-4a9f-97a1-81a9aed4d710 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119323 Sep 11 08:53:48.180819 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 419/859] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 08:53:48 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:53:48.192100 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f115423a-4889-455b-9962-8c7e365cf0f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:48.194978 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f115423a-4889-455b-9962-8c7e365cf0f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:48.204937 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f115423a-4889-455b-9962-8c7e365cf0f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:48.205787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f115423a-4889-455b-9962-8c7e365cf0f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:48.206827 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f115423a-4889-455b-9962-8c7e365cf0f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:48.208155 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f115423a-4889-455b-9962-8c7e365cf0f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:48.208991 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f115423a-4889-455b-9962-8c7e365cf0f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:48.209765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f115423a-4889-455b-9962-8c7e365cf0f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:48.605461 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:48.606468 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:48.608954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f115423a-4889-455b-9962-8c7e365cf0f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:48.613971 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:48.614752 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:48.618297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:48.618297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:48.618297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:48.618297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:48.624187 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f115423a-4889-455b-9962-8c7e365cf0f1 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.441417 Sep 11 08:53:48.626120 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 441/860] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:48 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:48.782492 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:48.794526 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:48.796776 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:48.798712 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5b3da3c5-e3f3-43f4-a96e-bc66348a6a3d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1719 microversion: 2.20 time: 0.199307 Sep 11 08:53:48.799333 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 420/861] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:48 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:49.041003 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:49.041626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] [instance: d0886581-401f-4faa-ac8b-1a5982e4f42c] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:49.049403 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:49.049903 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:49.050387 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:49.051128 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:49.051596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:49.052035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:49.069149 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] HTTP exception thrown: Instance d0886581-401f-4faa-ac8b-1a5982e4f42c could not be found. Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Request method failure captured: Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c HTTP/1.1 Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaGXLoMAwcFXPGfxwQZXt9Oe0NABj_yS42Unb-hLahM7OBFYLgVLEmLQ33pIGVRupqCKOntZ3iS0KKPe08_eOziUjZVYtqADsNa9kJHwXpZDjevXSwiOgnaxsgKBkeoQKhdEaFcSWg-n4SXU16PTZLuoHPKiURLk20rQWwT1cZDutB4 Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 94ceae42bd11404eaea28d523b98126e Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-VolumesSnapshotTestJSON-224181076 Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:53:49.072624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94ceae42bd11404eaea28d523b98126e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94ceae42bd11404eaea28d523b98126e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94ceae42bd11404eaea28d523b98126e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94ceae42bd11404eaea28d523b98126e", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-VolumesSnapshotTestJSON-224181076 Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 94ceae42bd11404eaea28d523b98126e Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-224181076 Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-VolumesSnapshotTestJSON-224181076-project Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: bae09cfbf3844b1682d8924e7d9578ee Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-VolumesSnapshotTestJSON-224181076-project Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance d0886581-401f-4faa-ac8b-1a5982e4f42c could not be found. Sep 11 08:53:49.075560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'd0886581-401f-4faa-ac8b-1a5982e4f42c'} Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0886581-401f-4faa-ac8b-1a5982e4f42c could not be found. Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:53:49.076947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0886581-401f-4faa-ac8b-1a5982e4f42c could not be found. Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0886581-401f-4faa-ac8b-1a5982e4f42c could not be found. Sep 11 08:53:49.081381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:53:49.085806 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] Returning 404 to user: Instance d0886581-401f-4faa-ac8b-1a5982e4f42c could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:53:49.085806 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7ed7a05c-e6ef-4ea7-832e-810d5462d4b5 tempest-VolumesSnapshotTestJSON-224181076 tempest-VolumesSnapshotTestJSON-224181076-project] 10.222.0.44 "GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c" status: 404 len: 111 microversion: 2.1 time: 0.037430 Sep 11 08:53:49.088451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 442/862] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:49 2022] GET /compute/v2.1/servers/d0886581-401f-4faa-ac8b-1a5982e4f42c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:53:49.653944 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6b7234b5-6b78-4f79-a7cf-4d4de0b22978 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:49.655482 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6b7234b5-6b78-4f79-a7cf-4d4de0b22978 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:49.667448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b7234b5-6b78-4f79-a7cf-4d4de0b22978 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:49.668380 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b7234b5-6b78-4f79-a7cf-4d4de0b22978 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:49.669087 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b7234b5-6b78-4f79-a7cf-4d4de0b22978 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:49.669944 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b7234b5-6b78-4f79-a7cf-4d4de0b22978 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:49.670489 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b7234b5-6b78-4f79-a7cf-4d4de0b22978 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:49.670964 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6b7234b5-6b78-4f79-a7cf-4d4de0b22978 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:49.693736 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=100 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:49.832464 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6b7234b5-6b78-4f79-a7cf-4d4de0b22978 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:49.839986 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:49.840797 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:49.842018 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6b7234b5-6b78-4f79-a7cf-4d4de0b22978 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.193784 Sep 11 08:53:49.842947 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 421/863] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:49 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:49.848637 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:49.849480 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:49.850104 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:49.851040 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:49.851500 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:49.851914 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:50.056763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c7f97377-258d-4732-bb21-ec34bbd1e961 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:50.059404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c7f97377-258d-4732-bb21-ec34bbd1e961 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:50.067702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c7f97377-258d-4732-bb21-ec34bbd1e961 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:50.068193 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c7f97377-258d-4732-bb21-ec34bbd1e961 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:50.068630 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c7f97377-258d-4732-bb21-ec34bbd1e961 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:50.069495 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c7f97377-258d-4732-bb21-ec34bbd1e961 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:50.069998 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c7f97377-258d-4732-bb21-ec34bbd1e961 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:50.070437 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c7f97377-258d-4732-bb21-ec34bbd1e961 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:50.120344 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c7f97377-258d-4732-bb21-ec34bbd1e961 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.068158 Sep 11 08:53:50.120945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 422/864] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:53:50 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:53:50.207909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-7d7ed801-8b3e-464a-ba1f-bd1af618de7d req-0196a1d7-25da-41af-a53d-ddfcf0ff1280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5fbae7-a31c-412a-997f-365bb68b7ea6", "tag": "5e23f4a5-938f-4956-9719-ad21eb95651c"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:50.218999 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-7d7ed801-8b3e-464a-ba1f-bd1af618de7d req-0196a1d7-25da-41af-a53d-ddfcf0ff1280 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:50.219471 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-7d7ed801-8b3e-464a-ba1f-bd1af618de7d req-0196a1d7-25da-41af-a53d-ddfcf0ff1280 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:50.220116 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-7d7ed801-8b3e-464a-ba1f-bd1af618de7d req-0196a1d7-25da-41af-a53d-ddfcf0ff1280 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:50.226272 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:50.234210 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-7d7ed801-8b3e-464a-ba1f-bd1af618de7d req-0196a1d7-25da-41af-a53d-ddfcf0ff1280 service nova] Creating event network-changed:5e23f4a5-938f-4956-9719-ad21eb95651c for instance be5fbae7-a31c-412a-997f-365bb68b7ea6 on hv-cinder-85694 Sep 11 08:53:50.235124 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:50.236625 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:50.237799 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-92fa1b99-0c03-4cc5-a231-76cf422973f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1719 microversion: 2.20 time: 0.404090 Sep 11 08:53:50.238632 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 443/865] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:49 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1719 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:53:50.239695 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-7d7ed801-8b3e-464a-ba1f-bd1af618de7d req-0196a1d7-25da-41af-a53d-ddfcf0ff1280 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035412 Sep 11 08:53:50.240807 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 423/866] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:53:50.265169 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7f24c630-5895-446f-9562-4376a47ed532 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:50.265706 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7f24c630-5895-446f-9562-4376a47ed532 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:50.272204 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7f24c630-5895-446f-9562-4376a47ed532 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:50.272700 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7f24c630-5895-446f-9562-4376a47ed532 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:50.273142 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7f24c630-5895-446f-9562-4376a47ed532 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:50.274002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7f24c630-5895-446f-9562-4376a47ed532 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:50.274422 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7f24c630-5895-446f-9562-4376a47ed532 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:50.274927 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7f24c630-5895-446f-9562-4376a47ed532 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:50.308981 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7f24c630-5895-446f-9562-4376a47ed532 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments/b20eeb38-5dae-4727-b3e8-d9073e1e5545" status: 200 len: 194 microversion: 2.1 time: 0.047445 Sep 11 08:53:50.309738 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 444/867] 10.222.0.44 () {58 vars in 1413 bytes} [Sun Sep 11 08:53:50 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments/b20eeb38-5dae-4727-b3e8-d9073e1e5545 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:53:50.320963 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5c3b7eb4-03d8-4bde-8cdc-231528e31b67 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:50.321661 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5c3b7eb4-03d8-4bde-8cdc-231528e31b67 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:50.328612 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c3b7eb4-03d8-4bde-8cdc-231528e31b67 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:50.329187 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c3b7eb4-03d8-4bde-8cdc-231528e31b67 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:50.329627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c3b7eb4-03d8-4bde-8cdc-231528e31b67 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:50.330389 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c3b7eb4-03d8-4bde-8cdc-231528e31b67 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:50.330849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c3b7eb4-03d8-4bde-8cdc-231528e31b67 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:50.331293 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5c3b7eb4-03d8-4bde-8cdc-231528e31b67 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:50.431432 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-5c3b7eb4-03d8-4bde-8cdc-231528e31b67 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'services' on Instance uuid d60e297f-d22d-4463-b9ed-d14b988add11 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:53:50.694330 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5c3b7eb4-03d8-4bde-8cdc-231528e31b67 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments/b20eeb38-5dae-4727-b3e8-d9073e1e5545" status: 202 len: 0 microversion: 2.1 time: 0.377411 Sep 11 08:53:50.695037 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 424/868] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:53:50 2022] DELETE /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments/b20eeb38-5dae-4727-b3e8-d9073e1e5545 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:53:50.867093 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ace76e41-518e-45f5-a6b3-ddf15a586490 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:50.867781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ace76e41-518e-45f5-a6b3-ddf15a586490 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:50.879587 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ace76e41-518e-45f5-a6b3-ddf15a586490 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:50.880079 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ace76e41-518e-45f5-a6b3-ddf15a586490 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:50.880569 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ace76e41-518e-45f5-a6b3-ddf15a586490 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:50.881223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ace76e41-518e-45f5-a6b3-ddf15a586490 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:50.881673 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ace76e41-518e-45f5-a6b3-ddf15a586490 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:50.882382 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ace76e41-518e-45f5-a6b3-ddf15a586490 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:51.031494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ace76e41-518e-45f5-a6b3-ddf15a586490 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:51.047749 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ace76e41-518e-45f5-a6b3-ddf15a586490 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.184957 Sep 11 08:53:51.049127 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 445/869] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:50 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:51.265066 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:51.265645 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:51.272833 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:51.273556 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:51.274392 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:51.275193 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:51.275859 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:51.276575 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:51.456004 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:51.465866 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:51.467370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:51.468544 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a7fbd358-76cc-4f27-abb4-951999cf54a8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1719 microversion: 2.20 time: 0.208619 Sep 11 08:53:51.469106 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 425/870] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:51 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1719 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:53:52.072514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d362018b-d405-49dc-a398-bfc162384dd8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:52.073123 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d362018b-d405-49dc-a398-bfc162384dd8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:52.079720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d362018b-d405-49dc-a398-bfc162384dd8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:52.080186 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d362018b-d405-49dc-a398-bfc162384dd8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:52.080659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d362018b-d405-49dc-a398-bfc162384dd8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:52.081339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d362018b-d405-49dc-a398-bfc162384dd8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:52.081790 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d362018b-d405-49dc-a398-bfc162384dd8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:52.082231 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d362018b-d405-49dc-a398-bfc162384dd8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:52.226992 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d362018b-d405-49dc-a398-bfc162384dd8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:52.235821 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d362018b-d405-49dc-a398-bfc162384dd8 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.167270 Sep 11 08:53:52.236402 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 446/871] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:52 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:52.495475 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:52.496121 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:52.498817 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=86 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:52.503792 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:52.504274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:52.504707 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:52.505402 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:52.505853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:52.506303 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:52.646233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:52.654972 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:52.656418 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:52.657597 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-7ca923fc-8e7f-44de-aef3-0d386363d199 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1719 microversion: 2.20 time: 0.166074 Sep 11 08:53:52.658420 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 426/872] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:52 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:53.259658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-aad92034-85dd-4462-aba4-0d932884ba3b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:53.260522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-aad92034-85dd-4462-aba4-0d932884ba3b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:53.267921 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aad92034-85dd-4462-aba4-0d932884ba3b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:53.268442 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aad92034-85dd-4462-aba4-0d932884ba3b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:53.268841 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aad92034-85dd-4462-aba4-0d932884ba3b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:53.269542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aad92034-85dd-4462-aba4-0d932884ba3b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:53.269994 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aad92034-85dd-4462-aba4-0d932884ba3b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:53.270454 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aad92034-85dd-4462-aba4-0d932884ba3b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:53.289377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:53:53.431351 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-aad92034-85dd-4462-aba4-0d932884ba3b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:53.441033 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-aad92034-85dd-4462-aba4-0d932884ba3b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.185280 Sep 11 08:53:53.441638 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 447/873] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:53 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:53.683587 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:53.684208 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:53.691728 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:53.692299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:53.692806 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:53.693567 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:53.694092 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:53.694798 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:53.840455 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:53.849586 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:53.851159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:53.852512 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-dab83160-bd8b-41df-aba3-91c7c2b8c445 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1719 microversion: 2.20 time: 0.172882 Sep 11 08:53:53.853078 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 427/874] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:53 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:54.469413 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-52590b3f-d93e-4111-b4ae-b32262742209 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:54.469982 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-52590b3f-d93e-4111-b4ae-b32262742209 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:54.482956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52590b3f-d93e-4111-b4ae-b32262742209 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:54.483453 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52590b3f-d93e-4111-b4ae-b32262742209 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:54.487153 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52590b3f-d93e-4111-b4ae-b32262742209 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:54.488118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52590b3f-d93e-4111-b4ae-b32262742209 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:54.488776 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52590b3f-d93e-4111-b4ae-b32262742209 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:54.490704 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-52590b3f-d93e-4111-b4ae-b32262742209 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:54.587208 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-23cefe74-7b76-4924-b5ec-769f44f4828d req-0af46d76-7819-4f90-bd94-1c0620fccc18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe", "name": "network-vif-unplugged", "status": "completed", "tag": "2a26af6d-2714-450a-b99a-6e72dec54d7e"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:54.603561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-23cefe74-7b76-4924-b5ec-769f44f4828d req-0af46d76-7819-4f90-bd94-1c0620fccc18 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:54.605392 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-23cefe74-7b76-4924-b5ec-769f44f4828d req-0af46d76-7819-4f90-bd94-1c0620fccc18 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:54.606726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-23cefe74-7b76-4924-b5ec-769f44f4828d req-0af46d76-7819-4f90-bd94-1c0620fccc18 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:54.625287 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-23cefe74-7b76-4924-b5ec-769f44f4828d req-0af46d76-7819-4f90-bd94-1c0620fccc18 service nova] Creating event network-vif-unplugged:2a26af6d-2714-450a-b99a-6e72dec54d7e for instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe on hv-cinder-85694 Sep 11 08:53:54.632099 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-23cefe74-7b76-4924-b5ec-769f44f4828d req-0af46d76-7819-4f90-bd94-1c0620fccc18 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062710 Sep 11 08:53:54.632715 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 428/875] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:54.857442 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-52590b3f-d93e-4111-b4ae-b32262742209 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:54.871240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-52590b3f-d93e-4111-b4ae-b32262742209 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.407444 Sep 11 08:53:54.871840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 448/876] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:54 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:54.880737 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:54.881281 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:54.888671 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:54.889173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:54.889618 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:54.890405 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:54.890867 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:54.891360 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:55.035218 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:55.060239 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:55.065964 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:55.068413 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-857c8215-e199-49cc-8f46-2ce8278d33b8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1722 microversion: 2.20 time: 0.192247 Sep 11 08:53:55.070178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 429/877] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:54 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:55.096830 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-153e011a-1317-42d9-a030-70201a1e2e1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a2d4034-db93-4bda-a1e0-aa049bf57c13"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:55.099839 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-153e011a-1317-42d9-a030-70201a1e2e1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:55.106448 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-153e011a-1317-42d9-a030-70201a1e2e1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:55.106980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-153e011a-1317-42d9-a030-70201a1e2e1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:55.107422 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-153e011a-1317-42d9-a030-70201a1e2e1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:55.108137 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-153e011a-1317-42d9-a030-70201a1e2e1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:55.108590 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-153e011a-1317-42d9-a030-70201a1e2e1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:55.109015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-153e011a-1317-42d9-a030-70201a1e2e1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:55.901990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-66a8680c-8362-454e-9b0f-d15f27c8723a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:55.902577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-66a8680c-8362-454e-9b0f-d15f27c8723a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:55.914879 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-66a8680c-8362-454e-9b0f-d15f27c8723a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:55.918399 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-66a8680c-8362-454e-9b0f-d15f27c8723a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:55.918399 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-66a8680c-8362-454e-9b0f-d15f27c8723a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:55.918399 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-66a8680c-8362-454e-9b0f-d15f27c8723a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:55.918399 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-66a8680c-8362-454e-9b0f-d15f27c8723a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:55.918757 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-66a8680c-8362-454e-9b0f-d15f27c8723a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:56.095831 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-66a8680c-8362-454e-9b0f-d15f27c8723a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:56.108519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-66a8680c-8362-454e-9b0f-d15f27c8723a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.207591 Sep 11 08:53:56.109467 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 430/878] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:55 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:56.475612 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-da28eeb6-0cde-4d38-b907-4cd4ba97ecc5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:56.476641 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-da28eeb6-0cde-4d38-b907-4cd4ba97ecc5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:56.487088 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da28eeb6-0cde-4d38-b907-4cd4ba97ecc5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:56.488140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da28eeb6-0cde-4d38-b907-4cd4ba97ecc5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:56.488938 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da28eeb6-0cde-4d38-b907-4cd4ba97ecc5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:56.490234 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da28eeb6-0cde-4d38-b907-4cd4ba97ecc5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:56.491044 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da28eeb6-0cde-4d38-b907-4cd4ba97ecc5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:56.491812 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-da28eeb6-0cde-4d38-b907-4cd4ba97ecc5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:56.526536 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-153e011a-1317-42d9-a030-70201a1e2e1d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "POST /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.434282 Sep 11 08:53:56.528672 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 449/879] 10.222.0.44 () {62 vars in 1364 bytes} [Sun Sep 11 08:53:55 2022] POST /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/os-volume_attachments => generated 188 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 11 08:53:56.549060 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-da28eeb6-0cde-4d38-b907-4cd4ba97ecc5 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments/ed2a0955-3c31-4ca1-88ae-11f7b361954a" status: 200 len: 194 microversion: 2.1 time: 0.080728 Sep 11 08:53:56.550322 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 431/880] 10.222.0.44 () {58 vars in 1413 bytes} [Sun Sep 11 08:53:56 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments/ed2a0955-3c31-4ca1-88ae-11f7b361954a => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:53:56.562532 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a67e34eb-ece0-45f4-b94b-0cdde63b9d4a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:56.562778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a67e34eb-ece0-45f4-b94b-0cdde63b9d4a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:56.569078 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a67e34eb-ece0-45f4-b94b-0cdde63b9d4a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:56.569748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a67e34eb-ece0-45f4-b94b-0cdde63b9d4a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:56.570086 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a67e34eb-ece0-45f4-b94b-0cdde63b9d4a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:56.571067 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a67e34eb-ece0-45f4-b94b-0cdde63b9d4a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:56.571756 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a67e34eb-ece0-45f4-b94b-0cdde63b9d4a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:56.572370 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a67e34eb-ece0-45f4-b94b-0cdde63b9d4a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:56.670880 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-a67e34eb-ece0-45f4-b94b-0cdde63b9d4a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'services' on Instance uuid d60e297f-d22d-4463-b9ed-d14b988add11 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:53:56.687622 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-34e3a175-75c8-49e6-8c7f-ccd653277478 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:56.688214 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-34e3a175-75c8-49e6-8c7f-ccd653277478 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:56.694529 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34e3a175-75c8-49e6-8c7f-ccd653277478 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:56.694986 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34e3a175-75c8-49e6-8c7f-ccd653277478 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:56.695406 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34e3a175-75c8-49e6-8c7f-ccd653277478 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:56.696111 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34e3a175-75c8-49e6-8c7f-ccd653277478 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:56.696597 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34e3a175-75c8-49e6-8c7f-ccd653277478 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:56.697020 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-34e3a175-75c8-49e6-8c7f-ccd653277478 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:56.944085 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a67e34eb-ece0-45f4-b94b-0cdde63b9d4a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments/ed2a0955-3c31-4ca1-88ae-11f7b361954a" status: 202 len: 0 microversion: 2.1 time: 0.386443 Sep 11 08:53:56.945117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 450/881] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:53:56 2022] DELETE /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments/ed2a0955-3c31-4ca1-88ae-11f7b361954a => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:53:57.134848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-29fa4bfa-6dbc-48d5-b2a3-676d2907e302 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:57.135765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-29fa4bfa-6dbc-48d5-b2a3-676d2907e302 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:57.141929 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29fa4bfa-6dbc-48d5-b2a3-676d2907e302 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:57.142461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29fa4bfa-6dbc-48d5-b2a3-676d2907e302 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:57.142992 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29fa4bfa-6dbc-48d5-b2a3-676d2907e302 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:57.143897 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29fa4bfa-6dbc-48d5-b2a3-676d2907e302 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:57.144061 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29fa4bfa-6dbc-48d5-b2a3-676d2907e302 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:57.144487 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29fa4bfa-6dbc-48d5-b2a3-676d2907e302 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:57.301337 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-29fa4bfa-6dbc-48d5-b2a3-676d2907e302 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:57.309320 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-29fa4bfa-6dbc-48d5-b2a3-676d2907e302 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.178737 Sep 11 08:53:57.310068 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 451/882] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:57 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:53:57.552796 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-34e3a175-75c8-49e6-8c7f-ccd653277478 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/os-volume_attachments/8a2d4034-db93-4bda-a1e0-aa049bf57c13" status: 202 len: 0 microversion: 2.20 time: 0.870594 Sep 11 08:53:57.554238 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 432/883] 10.222.0.44 () {60 vars in 1457 bytes} [Sun Sep 11 08:53:56 2022] DELETE /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/os-volume_attachments/8a2d4034-db93-4bda-a1e0-aa049bf57c13 => generated 0 bytes in 873 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 08:53:57.629956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f139fd5d-65e9-4391-972e-6d688edd9472 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:53:57.630849 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f139fd5d-65e9-4391-972e-6d688edd9472 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:57.637498 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f139fd5d-65e9-4391-972e-6d688edd9472 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:57.638643 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f139fd5d-65e9-4391-972e-6d688edd9472 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:57.639332 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f139fd5d-65e9-4391-972e-6d688edd9472 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:57.640275 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f139fd5d-65e9-4391-972e-6d688edd9472 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:57.640852 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f139fd5d-65e9-4391-972e-6d688edd9472 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:57.641284 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f139fd5d-65e9-4391-972e-6d688edd9472 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:57.693430 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f139fd5d-65e9-4391-972e-6d688edd9472 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127646) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 08:53:58.195631 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f139fd5d-65e9-4391-972e-6d688edd9472 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "POST /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/action" status: 202 len: 0 microversion: 2.20 time: 0.569631 Sep 11 08:53:58.196135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 452/884] 10.222.0.44 () {62 vars in 1319 bytes} [Sun Sep 11 08:53:57 2022] POST /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 11 08:53:58.212388 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:58.213512 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:58.229667 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:58.230550 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:58.231089 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:58.232726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:58.233295 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:58.233800 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:58.340242 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-83ff106f-c4b1-4b94-9691-5377f8bcfeae tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:58.343588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-83ff106f-c4b1-4b94-9691-5377f8bcfeae tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:58.378541 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83ff106f-c4b1-4b94-9691-5377f8bcfeae tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:58.386626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83ff106f-c4b1-4b94-9691-5377f8bcfeae tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:58.388911 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83ff106f-c4b1-4b94-9691-5377f8bcfeae tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:58.392353 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83ff106f-c4b1-4b94-9691-5377f8bcfeae tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:58.394800 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83ff106f-c4b1-4b94-9691-5377f8bcfeae tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:58.399710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-83ff106f-c4b1-4b94-9691-5377f8bcfeae tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:58.579226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:58.601690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:58.604231 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:58.605841 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-119325e4-991a-48e3-a3b4-5c9c53c4165e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1670 microversion: 2.20 time: 0.402685 Sep 11 08:53:58.608064 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 433/885] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:58 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1670 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:53:58.737638 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-83ff106f-c4b1-4b94-9691-5377f8bcfeae tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:58.756902 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-83ff106f-c4b1-4b94-9691-5377f8bcfeae tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.425763 Sep 11 08:53:58.758932 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 453/886] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:58 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:53:59.329617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-02795ad7-55cd-493e-a725-1be0c61e464f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:59.332929 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-02795ad7-55cd-493e-a725-1be0c61e464f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:59.342299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02795ad7-55cd-493e-a725-1be0c61e464f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:59.343086 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02795ad7-55cd-493e-a725-1be0c61e464f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:59.343749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02795ad7-55cd-493e-a725-1be0c61e464f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:59.344663 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02795ad7-55cd-493e-a725-1be0c61e464f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:59.345283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02795ad7-55cd-493e-a725-1be0c61e464f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:59.345823 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02795ad7-55cd-493e-a725-1be0c61e464f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:59.389199 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-02795ad7-55cd-493e-a725-1be0c61e464f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066010 Sep 11 08:53:59.390230 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 434/887] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:53:59 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 08:53:59.554265 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5cf95dca-c201-4888-9fc4-0e7c64228573 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:59.556579 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5cf95dca-c201-4888-9fc4-0e7c64228573 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:59.563754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf95dca-c201-4888-9fc4-0e7c64228573 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:59.564256 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf95dca-c201-4888-9fc4-0e7c64228573 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:59.564699 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf95dca-c201-4888-9fc4-0e7c64228573 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:59.565406 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf95dca-c201-4888-9fc4-0e7c64228573 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:59.565940 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf95dca-c201-4888-9fc4-0e7c64228573 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:59.566398 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf95dca-c201-4888-9fc4-0e7c64228573 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:59.603885 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5cf95dca-c201-4888-9fc4-0e7c64228573 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050354 Sep 11 08:53:59.603885 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 454/888] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:53:59 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 08:53:59.633627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:59.635483 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:59.643173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:59.643754 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:59.644260 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:59.645150 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:59.645696 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:59.646207 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:59.685725 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-94a0b75e-5537-40ee-b7d4-4eff93e878c4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:59.686499 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-94a0b75e-5537-40ee-b7d4-4eff93e878c4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:59.696934 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-94a0b75e-5537-40ee-b7d4-4eff93e878c4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:59.697688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-94a0b75e-5537-40ee-b7d4-4eff93e878c4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:59.698354 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-94a0b75e-5537-40ee-b7d4-4eff93e878c4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:59.699113 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-94a0b75e-5537-40ee-b7d4-4eff93e878c4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:59.699571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-94a0b75e-5537-40ee-b7d4-4eff93e878c4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:59.704495 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-94a0b75e-5537-40ee-b7d4-4eff93e878c4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:59.740355 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-94a0b75e-5537-40ee-b7d4-4eff93e878c4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Going to try to terminate instance {{(pid=127646) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:53:59.806021 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:59.815167 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:59.816651 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:53:59.817828 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4a9cbd9e-4e24-4abc-9e31-62fb1ca6cc6f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1670 microversion: 2.20 time: 0.188412 Sep 11 08:53:59.818442 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 435/889] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:53:59 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1670 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:53:59.823192 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-247ca40a-a58e-4f74-9b1e-d04c2fc187cf tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:53:59.823840 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-247ca40a-a58e-4f74-9b1e-d04c2fc187cf tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:53:59.830395 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-247ca40a-a58e-4f74-9b1e-d04c2fc187cf tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:59.830895 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-247ca40a-a58e-4f74-9b1e-d04c2fc187cf tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:59.831338 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-247ca40a-a58e-4f74-9b1e-d04c2fc187cf tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:59.832053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-247ca40a-a58e-4f74-9b1e-d04c2fc187cf tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:53:59.832512 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-247ca40a-a58e-4f74-9b1e-d04c2fc187cf tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:53:59.832934 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-247ca40a-a58e-4f74-9b1e-d04c2fc187cf tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:53:59.849347 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:00.024330 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-247ca40a-a58e-4f74-9b1e-d04c2fc187cf tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:00.033068 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-247ca40a-a58e-4f74-9b1e-d04c2fc187cf tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1571 microversion: 2.1 time: 0.213513 Sep 11 08:54:00.033991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 436/890] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:53:59 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1571 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:00.060882 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-47021e3b-37fd-4f59-bb03-0a1274e556b9 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:54:00.061644 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-47021e3b-37fd-4f59-bb03-0a1274e556b9 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:00.070165 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47021e3b-37fd-4f59-bb03-0a1274e556b9 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:00.070895 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47021e3b-37fd-4f59-bb03-0a1274e556b9 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:00.071404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47021e3b-37fd-4f59-bb03-0a1274e556b9 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:00.072343 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47021e3b-37fd-4f59-bb03-0a1274e556b9 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:00.072972 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47021e3b-37fd-4f59-bb03-0a1274e556b9 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:00.073630 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-47021e3b-37fd-4f59-bb03-0a1274e556b9 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:00.108869 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-47021e3b-37fd-4f59-bb03-0a1274e556b9 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127647) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 11 08:54:00.136643 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-94a0b75e-5537-40ee-b7d4-4eff93e878c4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 204 len: 0 microversion: 2.1 time: 0.457340 Sep 11 08:54:00.137257 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 455/891] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:53:59 2022] DELETE /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 08:54:00.146586 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-28e69468-61ed-44e6-bd95-5e6a24a5a335 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:00.147319 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-28e69468-61ed-44e6-bd95-5e6a24a5a335 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:00.154426 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28e69468-61ed-44e6-bd95-5e6a24a5a335 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:00.154923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28e69468-61ed-44e6-bd95-5e6a24a5a335 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:00.155443 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28e69468-61ed-44e6-bd95-5e6a24a5a335 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:00.156114 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28e69468-61ed-44e6-bd95-5e6a24a5a335 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:00.156567 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28e69468-61ed-44e6-bd95-5e6a24a5a335 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:00.156991 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-28e69468-61ed-44e6-bd95-5e6a24a5a335 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:00.305407 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-28e69468-61ed-44e6-bd95-5e6a24a5a335 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:00.313639 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-28e69468-61ed-44e6-bd95-5e6a24a5a335 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1673 microversion: 2.1 time: 0.171446 Sep 11 08:54:00.314310 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 456/892] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:00 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:54:00.580079 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-47021e3b-37fd-4f59-bb03-0a1274e556b9 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "POST /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b/action" status: 202 len: 0 microversion: 2.1 time: 0.526132 Sep 11 08:54:00.580982 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 437/893] 10.222.0.44 () {60 vars in 1278 bytes} [Sun Sep 11 08:54:00 2022] POST /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:54:00.594610 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-aac8036f-6b13-42dc-a6dc-37e25d6f5243 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:00.596076 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-aac8036f-6b13-42dc-a6dc-37e25d6f5243 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:00.607317 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aac8036f-6b13-42dc-a6dc-37e25d6f5243 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:00.608203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aac8036f-6b13-42dc-a6dc-37e25d6f5243 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:00.608812 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aac8036f-6b13-42dc-a6dc-37e25d6f5243 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:00.609858 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aac8036f-6b13-42dc-a6dc-37e25d6f5243 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:00.610440 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aac8036f-6b13-42dc-a6dc-37e25d6f5243 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:00.611150 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-aac8036f-6b13-42dc-a6dc-37e25d6f5243 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:00.815740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-aac8036f-6b13-42dc-a6dc-37e25d6f5243 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:00.830077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-aac8036f-6b13-42dc-a6dc-37e25d6f5243 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1579 microversion: 2.1 time: 0.243556 Sep 11 08:54:00.831260 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 457/894] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:00 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1579 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:00.846217 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:00.847258 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:00.854214 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:00.854849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:00.861771 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:00.862750 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:00.863349 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:00.863862 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:01.062813 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:01.081977 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:01.085139 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:01.087595 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-41acb852-a6f3-4621-bf25-8f8b8d0c018b tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1670 microversion: 2.20 time: 0.246091 Sep 11 08:54:01.090237 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 438/895] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:00 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:54:01.337881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e4642f3a-dfdc-4ea2-89c3-0805d777e935 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:01.338420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e4642f3a-dfdc-4ea2-89c3-0805d777e935 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:01.345116 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4642f3a-dfdc-4ea2-89c3-0805d777e935 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:01.345610 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4642f3a-dfdc-4ea2-89c3-0805d777e935 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:01.346055 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4642f3a-dfdc-4ea2-89c3-0805d777e935 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:01.346798 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4642f3a-dfdc-4ea2-89c3-0805d777e935 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:01.347256 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4642f3a-dfdc-4ea2-89c3-0805d777e935 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:01.347752 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e4642f3a-dfdc-4ea2-89c3-0805d777e935 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:01.350714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:01.500146 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e4642f3a-dfdc-4ea2-89c3-0805d777e935 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:01.512469 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e4642f3a-dfdc-4ea2-89c3-0805d777e935 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1673 microversion: 2.1 time: 0.178658 Sep 11 08:54:01.513132 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 458/896] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:01 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:54:01.870464 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1bb211ea-c4ef-4974-bfba-29f4ba104087 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:01.871098 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1bb211ea-c4ef-4974-bfba-29f4ba104087 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:01.878598 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1bb211ea-c4ef-4974-bfba-29f4ba104087 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:01.879097 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1bb211ea-c4ef-4974-bfba-29f4ba104087 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:01.879629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1bb211ea-c4ef-4974-bfba-29f4ba104087 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:01.880365 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1bb211ea-c4ef-4974-bfba-29f4ba104087 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:01.880822 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1bb211ea-c4ef-4974-bfba-29f4ba104087 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:01.881245 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1bb211ea-c4ef-4974-bfba-29f4ba104087 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:02.027451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1bb211ea-c4ef-4974-bfba-29f4ba104087 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:02.036245 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1bb211ea-c4ef-4974-bfba-29f4ba104087 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1519 microversion: 2.1 time: 0.169633 Sep 11 08:54:02.036822 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 439/897] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:01 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:54:02.115813 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:02.116742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:02.124660 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:02.125078 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:02.125523 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:02.126243 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:02.126706 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:02.127128 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:02.267223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:02.277781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:02.279596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:02.281030 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-29f86d4b-51c9-4ba1-9dea-08cc2236c2ab tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1670 microversion: 2.20 time: 0.169180 Sep 11 08:54:02.281754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 459/898] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:02 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:02.535246 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-79a7d1b3-e124-4c52-bdf2-d954ffaae3b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:02.537068 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-79a7d1b3-e124-4c52-bdf2-d954ffaae3b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:02.542188 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79a7d1b3-e124-4c52-bdf2-d954ffaae3b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:02.542699 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79a7d1b3-e124-4c52-bdf2-d954ffaae3b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:02.543254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79a7d1b3-e124-4c52-bdf2-d954ffaae3b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:02.543908 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79a7d1b3-e124-4c52-bdf2-d954ffaae3b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:02.544358 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79a7d1b3-e124-4c52-bdf2-d954ffaae3b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:02.544875 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-79a7d1b3-e124-4c52-bdf2-d954ffaae3b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:02.685588 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-79a7d1b3-e124-4c52-bdf2-d954ffaae3b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:02.694361 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-79a7d1b3-e124-4c52-bdf2-d954ffaae3b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1673 microversion: 2.1 time: 0.162826 Sep 11 08:54:02.694950 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 440/899] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:02 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:03.059190 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f0e84a4f-7799-4802-ab89-5a1f4c0a88d0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:03.059817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f0e84a4f-7799-4802-ab89-5a1f4c0a88d0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:03.067080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0e84a4f-7799-4802-ab89-5a1f4c0a88d0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:03.067593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0e84a4f-7799-4802-ab89-5a1f4c0a88d0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:03.068040 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0e84a4f-7799-4802-ab89-5a1f4c0a88d0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:03.068763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0e84a4f-7799-4802-ab89-5a1f4c0a88d0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:03.069227 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0e84a4f-7799-4802-ab89-5a1f4c0a88d0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:03.069660 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f0e84a4f-7799-4802-ab89-5a1f4c0a88d0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:03.214639 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f0e84a4f-7799-4802-ab89-5a1f4c0a88d0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:03.223965 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f0e84a4f-7799-4802-ab89-5a1f4c0a88d0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1519 microversion: 2.1 time: 0.168625 Sep 11 08:54:03.224558 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 460/900] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:03 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:03.307590 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:03.308299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:03.316185 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:03.316649 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:03.317439 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:03.318456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:03.318920 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:03.319345 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:03.459388 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:03.468039 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:03.469457 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:03.470669 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2371d0ac-acfb-47b5-bd21-c67a6e7929e4 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1670 microversion: 2.20 time: 0.167544 Sep 11 08:54:03.475607 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 441/901] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:03 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:03.719484 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c3cd145e-2d65-410f-a9ed-dc17a56f91af tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:03.720093 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c3cd145e-2d65-410f-a9ed-dc17a56f91af tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:03.726526 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3cd145e-2d65-410f-a9ed-dc17a56f91af tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:03.727008 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3cd145e-2d65-410f-a9ed-dc17a56f91af tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:03.727511 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3cd145e-2d65-410f-a9ed-dc17a56f91af tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:03.728188 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3cd145e-2d65-410f-a9ed-dc17a56f91af tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:03.728637 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3cd145e-2d65-410f-a9ed-dc17a56f91af tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:03.729052 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c3cd145e-2d65-410f-a9ed-dc17a56f91af tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:03.882257 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c3cd145e-2d65-410f-a9ed-dc17a56f91af tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:03.886100 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c3cd145e-2d65-410f-a9ed-dc17a56f91af tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1673 microversion: 2.1 time: 0.171215 Sep 11 08:54:03.886712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 461/902] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:03 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:04.249377 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-02d970fd-fdd2-4baa-9a00-9462c2cc7c51 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:04.249909 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-02d970fd-fdd2-4baa-9a00-9462c2cc7c51 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:04.257923 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d970fd-fdd2-4baa-9a00-9462c2cc7c51 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:04.264720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d970fd-fdd2-4baa-9a00-9462c2cc7c51 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:04.264720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d970fd-fdd2-4baa-9a00-9462c2cc7c51 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:04.264720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d970fd-fdd2-4baa-9a00-9462c2cc7c51 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:04.264720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d970fd-fdd2-4baa-9a00-9462c2cc7c51 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:04.265328 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d970fd-fdd2-4baa-9a00-9462c2cc7c51 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:04.400572 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-02d970fd-fdd2-4baa-9a00-9462c2cc7c51 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:04.408757 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-02d970fd-fdd2-4baa-9a00-9462c2cc7c51 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1519 microversion: 2.1 time: 0.163991 Sep 11 08:54:04.409334 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 442/903] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:04 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:04.497710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:04.498956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:04.505351 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:04.505775 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:04.506235 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:04.506925 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:04.507378 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:04.507800 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:04.651245 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:04.661535 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:04.663065 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:04.664376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4fa2ddca-f9d7-405f-aaaf-b074f7c23ebb tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1670 microversion: 2.20 time: 0.170822 Sep 11 08:54:04.665211 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 462/904] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:04 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:04.686577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-5b27c96f-ce9b-4d15-bc73-39dab64ffe2c req-27361e8f-5375-4961-98aa-528c528eff7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c90788-7f2f-48f0-bdcb-1b66a5c48f8b", "name": "network-vif-unplugged", "status": "completed", "tag": "d9c7e947-ce3e-4ea3-8867-16f246a7639b"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:54:04.696620 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-5b27c96f-ce9b-4d15-bc73-39dab64ffe2c req-27361e8f-5375-4961-98aa-528c528eff7f service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:04.697109 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-5b27c96f-ce9b-4d15-bc73-39dab64ffe2c req-27361e8f-5375-4961-98aa-528c528eff7f service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:04.697537 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-5b27c96f-ce9b-4d15-bc73-39dab64ffe2c req-27361e8f-5375-4961-98aa-528c528eff7f service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:04.712925 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.compute.server_external_events [req-5b27c96f-ce9b-4d15-bc73-39dab64ffe2c req-27361e8f-5375-4961-98aa-528c528eff7f service nova] Unable to find a host for instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b. Dropping event network-vif-unplugged {{(pid=127647) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 11 08:54:04.712925 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-5b27c96f-ce9b-4d15-bc73-39dab64ffe2c req-27361e8f-5375-4961-98aa-528c528eff7f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030785 Sep 11 08:54:04.713503 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 443/905] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 11 08:54:04.909670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e01b2652-1168-45f4-b8ff-79ff6c9c64f8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:04.910565 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e01b2652-1168-45f4-b8ff-79ff6c9c64f8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:04.916689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e01b2652-1168-45f4-b8ff-79ff6c9c64f8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:04.917182 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e01b2652-1168-45f4-b8ff-79ff6c9c64f8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:04.917622 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e01b2652-1168-45f4-b8ff-79ff6c9c64f8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:04.918379 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e01b2652-1168-45f4-b8ff-79ff6c9c64f8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:04.918851 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e01b2652-1168-45f4-b8ff-79ff6c9c64f8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:04.919302 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e01b2652-1168-45f4-b8ff-79ff6c9c64f8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:05.064381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e01b2652-1168-45f4-b8ff-79ff6c9c64f8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:05.073857 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e01b2652-1168-45f4-b8ff-79ff6c9c64f8 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1673 microversion: 2.1 time: 0.168095 Sep 11 08:54:05.077714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 463/906] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:04 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:54:05.433408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-31a4ed00-dad9-444a-89ad-6d60ebabe7b2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:05.434134 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-31a4ed00-dad9-444a-89ad-6d60ebabe7b2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:05.441842 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31a4ed00-dad9-444a-89ad-6d60ebabe7b2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:05.442474 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31a4ed00-dad9-444a-89ad-6d60ebabe7b2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:05.442898 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31a4ed00-dad9-444a-89ad-6d60ebabe7b2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:05.443707 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31a4ed00-dad9-444a-89ad-6d60ebabe7b2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:05.444382 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31a4ed00-dad9-444a-89ad-6d60ebabe7b2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:05.445124 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-31a4ed00-dad9-444a-89ad-6d60ebabe7b2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:05.627001 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-31a4ed00-dad9-444a-89ad-6d60ebabe7b2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:05.636653 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-31a4ed00-dad9-444a-89ad-6d60ebabe7b2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1521 microversion: 2.1 time: 0.207112 Sep 11 08:54:05.637472 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 444/907] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:05 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:05.691555 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:05.692206 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:05.700006 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:05.700595 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:05.701728 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:05.702604 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:05.703127 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:05.703617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:06.097539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-87f7367a-3d03-4aa2-9744-bcd1e5aa26fa tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:06.098180 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-87f7367a-3d03-4aa2-9744-bcd1e5aa26fa tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:06.104225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87f7367a-3d03-4aa2-9744-bcd1e5aa26fa tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:06.104749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87f7367a-3d03-4aa2-9744-bcd1e5aa26fa tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:06.105190 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87f7367a-3d03-4aa2-9744-bcd1e5aa26fa tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:06.105897 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87f7367a-3d03-4aa2-9744-bcd1e5aa26fa tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:06.106390 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87f7367a-3d03-4aa2-9744-bcd1e5aa26fa tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:06.106822 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87f7367a-3d03-4aa2-9744-bcd1e5aa26fa tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:06.276662 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-87f7367a-3d03-4aa2-9744-bcd1e5aa26fa tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:06.286324 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-87f7367a-3d03-4aa2-9744-bcd1e5aa26fa tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1673 microversion: 2.1 time: 0.192486 Sep 11 08:54:06.286677 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:06.287739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 445/908] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:06 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:54:06.305698 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:06.307709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:06.309006 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-876a1488-ffce-436d-8692-f25b01b099a0 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.621411 Sep 11 08:54:06.309815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 464/909] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:05 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:06.673083 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6c1b25d2-dbf1-4ec2-930c-f8fe92240be4 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:06.675147 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6c1b25d2-dbf1-4ec2-930c-f8fe92240be4 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:06.682856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c1b25d2-dbf1-4ec2-930c-f8fe92240be4 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:06.683357 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c1b25d2-dbf1-4ec2-930c-f8fe92240be4 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:06.683799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c1b25d2-dbf1-4ec2-930c-f8fe92240be4 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:06.684829 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c1b25d2-dbf1-4ec2-930c-f8fe92240be4 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:06.686096 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c1b25d2-dbf1-4ec2-930c-f8fe92240be4 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:06.686708 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6c1b25d2-dbf1-4ec2-930c-f8fe92240be4 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:06.835492 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-6c1b25d2-dbf1-4ec2-930c-f8fe92240be4 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:06.848203 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6c1b25d2-dbf1-4ec2-930c-f8fe92240be4 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1521 microversion: 2.1 time: 0.184724 Sep 11 08:54:06.848816 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 446/910] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:06 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:07.089343 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-851b0335-f302-4910-a453-e00cd753f2b7 req-084f33d7-b853-4db9-a179-4e4daf34915a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60e297f-d22d-4463-b9ed-d14b988add11", "name": "network-vif-deleted", "tag": "d991a1cd-4fdf-4ff9-a1ce-1dea58bcca53"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:54:07.113366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-851b0335-f302-4910-a453-e00cd753f2b7 req-084f33d7-b853-4db9-a179-4e4daf34915a service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:07.113871 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-851b0335-f302-4910-a453-e00cd753f2b7 req-084f33d7-b853-4db9-a179-4e4daf34915a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:07.114346 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-851b0335-f302-4910-a453-e00cd753f2b7 req-084f33d7-b853-4db9-a179-4e4daf34915a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:07.128340 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-851b0335-f302-4910-a453-e00cd753f2b7 req-084f33d7-b853-4db9-a179-4e4daf34915a service nova] Creating event network-vif-deleted:d991a1cd-4fdf-4ff9-a1ce-1dea58bcca53 for instance d60e297f-d22d-4463-b9ed-d14b988add11 on hv-cinder-85694 Sep 11 08:54:07.133740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-851b0335-f302-4910-a453-e00cd753f2b7 req-084f33d7-b853-4db9-a179-4e4daf34915a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051017 Sep 11 08:54:07.134724 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 465/911] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:54:07.313264 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-20318b8c-e1b3-4464-adf9-effce353bf9f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:07.314291 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-20318b8c-e1b3-4464-adf9-effce353bf9f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:07.321445 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20318b8c-e1b3-4464-adf9-effce353bf9f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:07.322093 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20318b8c-e1b3-4464-adf9-effce353bf9f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:07.322830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20318b8c-e1b3-4464-adf9-effce353bf9f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:07.323807 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20318b8c-e1b3-4464-adf9-effce353bf9f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:07.324500 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20318b8c-e1b3-4464-adf9-effce353bf9f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:07.325419 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-20318b8c-e1b3-4464-adf9-effce353bf9f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:07.343036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:07.346273 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:07.357985 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:07.358848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:07.359274 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:07.360249 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:07.360877 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:07.361489 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:07.444300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-20318b8c-e1b3-4464-adf9-effce353bf9f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:07.457358 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-20318b8c-e1b3-4464-adf9-effce353bf9f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1322 microversion: 2.1 time: 0.148028 Sep 11 08:54:07.458253 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 447/912] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:07 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:54:07.562336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:07.583307 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:07.585235 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:07.589289 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-31b3563e-3ed9-4d7d-b760-2dffe91bf933 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.252854 Sep 11 08:54:07.590684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 466/913] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:07 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:54:07.873875 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-8bc9fa0a-9c4e-4d92-a466-04b319849300 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:07.874851 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-8bc9fa0a-9c4e-4d92-a466-04b319849300 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:07.882463 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bc9fa0a-9c4e-4d92-a466-04b319849300 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:07.883094 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bc9fa0a-9c4e-4d92-a466-04b319849300 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:07.883617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bc9fa0a-9c4e-4d92-a466-04b319849300 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:07.884342 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bc9fa0a-9c4e-4d92-a466-04b319849300 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:07.884902 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bc9fa0a-9c4e-4d92-a466-04b319849300 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:07.885334 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-8bc9fa0a-9c4e-4d92-a466-04b319849300 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:08.399323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-8bc9fa0a-9c4e-4d92-a466-04b319849300 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:08.411799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-8bc9fa0a-9c4e-4d92-a466-04b319849300 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.542410 Sep 11 08:54:08.413087 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 448/914] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:07 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:08.481783 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:08.483638 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:08.491047 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:08.491693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:08.492333 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:08.493319 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:08.493778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:08.494235 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:08.537321 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:08.537819 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:08.538356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:08.538819 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'fault' on Instance uuid d60e297f-d22d-4463-b9ed-d14b988add11 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:54:08.593735 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:08.602332 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-cb6c6805-4288-4355-aff0-fbe1e54f20b4 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1327 microversion: 2.1 time: 0.125031 Sep 11 08:54:08.614704 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 467/915] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:08 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1327 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:08.618138 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:08.618858 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:08.631612 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:08.632453 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:08.633093 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:08.634023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:08.635097 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:08.637561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:08.883451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:08.894553 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:08.899075 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:08.899075 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-30510d3c-d80d-4c07-a61c-40e74b73c325 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.283711 Sep 11 08:54:08.899075 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 449/916] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:08 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:09.443371 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-da427c16-89b5-4aa1-907e-81360557325b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:09.443982 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-da427c16-89b5-4aa1-907e-81360557325b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:09.450383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-da427c16-89b5-4aa1-907e-81360557325b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:09.452154 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-da427c16-89b5-4aa1-907e-81360557325b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:09.452799 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-da427c16-89b5-4aa1-907e-81360557325b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:09.454058 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-da427c16-89b5-4aa1-907e-81360557325b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:09.454961 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-da427c16-89b5-4aa1-907e-81360557325b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:09.455723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-da427c16-89b5-4aa1-907e-81360557325b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:09.627778 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:09.631920 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:09.642758 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-da427c16-89b5-4aa1-907e-81360557325b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:09.645315 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:09.647440 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:09.650339 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:09.651229 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:09.651717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:09.652158 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:09.653071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-da427c16-89b5-4aa1-907e-81360557325b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.213801 Sep 11 08:54:09.655287 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 468/917] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:09 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:09.688554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:09.689381 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:09.689929 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:09.690815 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'fault' on Instance uuid d60e297f-d22d-4463-b9ed-d14b988add11 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:54:09.740918 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:09.749977 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-305a03b5-8aa1-411a-b010-4d065eaa2440 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1327 microversion: 2.1 time: 0.125940 Sep 11 08:54:09.750770 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 450/918] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:09 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:09.924320 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:09.924923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:09.927996 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:09.931660 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:09.932143 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:09.932576 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:09.933274 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:09.933722 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:09.934185 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:10.078863 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:10.087817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:10.089568 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:10.090968 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-707fe4ae-7775-46d7-9d5c-7d6eb8e7d82e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.171236 Sep 11 08:54:10.099346 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 469/919] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:09 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:54:10.681244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-67deddfa-64f7-4013-8c61-0c4c3fc2f3e5 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:10.682515 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-67deddfa-64f7-4013-8c61-0c4c3fc2f3e5 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:10.696210 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-67deddfa-64f7-4013-8c61-0c4c3fc2f3e5 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:10.697036 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-67deddfa-64f7-4013-8c61-0c4c3fc2f3e5 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:10.697766 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-67deddfa-64f7-4013-8c61-0c4c3fc2f3e5 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:10.698990 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-67deddfa-64f7-4013-8c61-0c4c3fc2f3e5 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:10.700013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-67deddfa-64f7-4013-8c61-0c4c3fc2f3e5 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:10.701013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-67deddfa-64f7-4013-8c61-0c4c3fc2f3e5 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:10.784402 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:10.786436 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:10.798727 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:10.799603 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:10.806432 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:10.806432 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:10.806432 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:10.806432 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:10.881002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:10.881409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:10.881850 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:10.882656 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'fault' on Instance uuid d60e297f-d22d-4463-b9ed-d14b988add11 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:54:10.940238 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:10.942613 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-67deddfa-64f7-4013-8c61-0c4c3fc2f3e5 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:10.949151 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-095cf6cd-8bea-4fc4-94e2-bb739d7ccd6b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1327 microversion: 2.1 time: 0.177617 Sep 11 08:54:10.949751 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 470/920] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:10 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1327 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:10.953347 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-67deddfa-64f7-4013-8c61-0c4c3fc2f3e5 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.278447 Sep 11 08:54:10.955690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 451/921] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:10 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:11.119347 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:11.120273 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:11.127488 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:11.128259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:11.128709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:11.129431 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:11.129893 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:11.130489 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:11.331630 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:11.347779 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:11.349626 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:11.350763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d59e1bae-35c9-4394-a3d6-1516ae85714c tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.235418 Sep 11 08:54:11.362219 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 471/922] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:11 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:11.989480 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f6ef86a9-595a-4e0b-bb78-09d4c6e90683 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:11.990605 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f6ef86a9-595a-4e0b-bb78-09d4c6e90683 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:11.995256 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:11.997386 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:12.003835 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f6ef86a9-595a-4e0b-bb78-09d4c6e90683 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:12.003835 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f6ef86a9-595a-4e0b-bb78-09d4c6e90683 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:12.004674 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f6ef86a9-595a-4e0b-bb78-09d4c6e90683 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:12.006283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f6ef86a9-595a-4e0b-bb78-09d4c6e90683 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:12.010083 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f6ef86a9-595a-4e0b-bb78-09d4c6e90683 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:12.011467 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f6ef86a9-595a-4e0b-bb78-09d4c6e90683 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:12.014516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:12.016036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:12.017034 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:12.019096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:12.020371 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:12.021453 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:12.054330 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:12.080638 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:12.081542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:12.082293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:12.082993 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'fault' on Instance uuid d60e297f-d22d-4463-b9ed-d14b988add11 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:54:12.132287 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:12.144816 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-be5b23be-a807-4da3-945b-6303857d9e09 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1327 microversion: 2.1 time: 0.157974 Sep 11 08:54:12.146263 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 472/923] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:11 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1327 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:12.256915 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f6ef86a9-595a-4e0b-bb78-09d4c6e90683 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:12.271774 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f6ef86a9-595a-4e0b-bb78-09d4c6e90683 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.286748 Sep 11 08:54:12.272833 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 452/924] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:11 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:12.377990 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:12.379515 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:12.387314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:12.388255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:12.389015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:12.390422 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:12.391056 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:12.391617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:12.554332 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:12.565522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:12.567196 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:12.568649 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-613339b4-c17c-490e-b078-edf466e60856 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.195443 Sep 11 08:54:12.569688 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 473/925] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:12 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:13.177282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:13.178768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:13.186903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:13.188622 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:13.189446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:13.190688 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:13.191640 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:13.192181 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:13.257494 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:13.257984 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:13.258551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:13.259175 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'fault' on Instance uuid d60e297f-d22d-4463-b9ed-d14b988add11 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:54:13.297956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ff940dd3-505e-4565-990b-62b2a181bf49 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:13.298911 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ff940dd3-505e-4565-990b-62b2a181bf49 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:13.309917 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ff940dd3-505e-4565-990b-62b2a181bf49 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:13.309917 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ff940dd3-505e-4565-990b-62b2a181bf49 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:13.310847 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ff940dd3-505e-4565-990b-62b2a181bf49 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:13.311992 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ff940dd3-505e-4565-990b-62b2a181bf49 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:13.311992 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ff940dd3-505e-4565-990b-62b2a181bf49 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:13.312388 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ff940dd3-505e-4565-990b-62b2a181bf49 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:13.314570 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:13.324774 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-58cbf7dc-07e5-4518-84f4-72ac59fee72b tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1327 microversion: 2.1 time: 0.151805 Sep 11 08:54:13.326396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 453/926] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:13 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1327 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:13.349368 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:13.489482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ff940dd3-505e-4565-990b-62b2a181bf49 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:13.502028 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ff940dd3-505e-4565-990b-62b2a181bf49 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.208417 Sep 11 08:54:13.503892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 474/927] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:13 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:13.600898 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:13.601857 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:13.609124 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:13.609888 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:13.613726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:13.613726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:13.613726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:13.613726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:13.774051 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:13.783069 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:13.784553 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:13.785724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c1d8ae46-1cb6-4b87-91d6-2e676fb532f6 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.191853 Sep 11 08:54:13.786351 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 454/928] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:13 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:14.352876 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:14.353568 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:14.364503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:14.365081 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:14.365680 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:14.366487 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:14.366958 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:14.367390 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:14.408522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:14.409096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:14.409646 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:14.415547 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'fault' on Instance uuid d60e297f-d22d-4463-b9ed-d14b988add11 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:54:14.488673 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:14.496767 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5c95650e-55a2-496c-b54a-1772b8211686 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1327 microversion: 2.1 time: 0.148485 Sep 11 08:54:14.508443 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 475/929] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:14 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1327 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:14.529906 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3f808763-73df-4c62-9094-8216174e2d8e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:14.529906 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3f808763-73df-4c62-9094-8216174e2d8e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:14.533843 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f808763-73df-4c62-9094-8216174e2d8e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:14.534425 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f808763-73df-4c62-9094-8216174e2d8e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:14.535104 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f808763-73df-4c62-9094-8216174e2d8e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:14.535877 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f808763-73df-4c62-9094-8216174e2d8e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:14.536399 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f808763-73df-4c62-9094-8216174e2d8e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:14.536892 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3f808763-73df-4c62-9094-8216174e2d8e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:14.718226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3f808763-73df-4c62-9094-8216174e2d8e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:14.728226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3f808763-73df-4c62-9094-8216174e2d8e tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.205295 Sep 11 08:54:14.729107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 455/930] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:14 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:14.813053 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:14.813684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:14.820321 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:14.820820 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:14.821261 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:14.822014 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:14.822515 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:14.823012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:14.970769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:14.986945 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:14.989604 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:14.991412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-fa87a5c9-380b-4bd4-8dfa-a7e373b7a175 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.182877 Sep 11 08:54:15.008124 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 476/931] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:14 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:15.524415 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:15.525038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:15.531863 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:15.532633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:15.532802 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:15.533516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:15.533972 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:15.534431 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:15.568326 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:15.568818 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:15.569255 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:15.569708 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'fault' on Instance uuid d60e297f-d22d-4463-b9ed-d14b988add11 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:54:15.637032 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:15.646801 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c0d0c7d2-9fd3-4251-98a7-23d64cf54556 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1327 microversion: 2.1 time: 0.126305 Sep 11 08:54:15.647498 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 456/932] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:15 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:15.755657 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f7755764-6460-4769-b9da-a1531183be22 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:15.756990 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f7755764-6460-4769-b9da-a1531183be22 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:15.765093 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f7755764-6460-4769-b9da-a1531183be22 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:15.765495 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f7755764-6460-4769-b9da-a1531183be22 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:15.765943 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f7755764-6460-4769-b9da-a1531183be22 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:15.766677 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f7755764-6460-4769-b9da-a1531183be22 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:15.767186 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f7755764-6460-4769-b9da-a1531183be22 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:15.767613 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f7755764-6460-4769-b9da-a1531183be22 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:15.947156 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f7755764-6460-4769-b9da-a1531183be22 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:15.956030 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f7755764-6460-4769-b9da-a1531183be22 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.204509 Sep 11 08:54:15.965324 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 477/933] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:15 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:54:16.021371 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:16.022292 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:16.029871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:16.030695 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:16.031136 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:16.031858 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:16.032316 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:16.032939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:16.189237 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:16.199165 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:16.201248 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:16.202559 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4e17f2d9-7bbb-498b-ad22-43d0ad11738a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.185633 Sep 11 08:54:16.205434 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 457/934] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:16 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 11 08:54:16.670631 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:16.671178 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:16.679011 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:16.680070 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:16.680070 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:16.680826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:16.681284 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:16.681712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:16.725903 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:16.726415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:16.726857 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:16.727304 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'fault' on Instance uuid d60e297f-d22d-4463-b9ed-d14b988add11 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:54:16.772149 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:16.780852 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d2542b6b-dd9c-4cf4-83ed-5ebc215d2df9 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1327 microversion: 2.1 time: 0.114372 Sep 11 08:54:16.783301 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 478/935] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:16 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:16.980552 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ca328d57-423e-4922-8985-0857f745aa1c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:16.981115 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ca328d57-423e-4922-8985-0857f745aa1c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:16.987900 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca328d57-423e-4922-8985-0857f745aa1c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:16.988383 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca328d57-423e-4922-8985-0857f745aa1c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:16.988821 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca328d57-423e-4922-8985-0857f745aa1c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:16.989535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca328d57-423e-4922-8985-0857f745aa1c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:16.989989 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca328d57-423e-4922-8985-0857f745aa1c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:16.990439 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ca328d57-423e-4922-8985-0857f745aa1c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:17.125989 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ca328d57-423e-4922-8985-0857f745aa1c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:17.134837 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ca328d57-423e-4922-8985-0857f745aa1c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.158221 Sep 11 08:54:17.135440 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 458/936] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:16 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:17.229383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:17.229997 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:17.237735 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:17.238178 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:17.238637 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:17.239500 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:17.239989 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:17.240437 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:17.439586 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:17.447952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:17.449394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:17.451220 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6c3a45ba-2f02-43ac-ad98-36d0bd9626db tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.225421 Sep 11 08:54:17.451774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 479/937] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:17 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:17.804735 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:17.805379 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:17.813023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:17.813023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:17.813285 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:17.814196 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:17.814812 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:17.815407 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:17.847570 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:17.848005 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:17.848443 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:17.848895 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lazy-loading 'fault' on Instance uuid d60e297f-d22d-4463-b9ed-d14b988add11 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:54:17.900575 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abba619decf448db477533c663004bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347504c603af4937b829f24349b013c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:17.909765 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-269f3912-eb0b-445e-b1b4-7b8e0b30eb00 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 200 len: 1327 microversion: 2.1 time: 0.109061 Sep 11 08:54:17.924991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 459/938] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:17 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:18.158541 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a4eecd09-0a3a-4fdf-a2a3-fc7cf5c02e40 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:18.159324 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-a4eecd09-0a3a-4fdf-a2a3-fc7cf5c02e40 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:18.166181 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4eecd09-0a3a-4fdf-a2a3-fc7cf5c02e40 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:18.166758 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4eecd09-0a3a-4fdf-a2a3-fc7cf5c02e40 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:18.167296 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4eecd09-0a3a-4fdf-a2a3-fc7cf5c02e40 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:18.168000 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4eecd09-0a3a-4fdf-a2a3-fc7cf5c02e40 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:18.168457 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4eecd09-0a3a-4fdf-a2a3-fc7cf5c02e40 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:18.168881 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-a4eecd09-0a3a-4fdf-a2a3-fc7cf5c02e40 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:18.373712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-a4eecd09-0a3a-4fdf-a2a3-fc7cf5c02e40 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:18.382760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a4eecd09-0a3a-4fdf-a2a3-fc7cf5c02e40 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.228102 Sep 11 08:54:18.383349 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 480/939] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:18 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:54:18.479290 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:18.480718 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:18.494220 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:18.494718 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:18.495365 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:18.496090 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:18.496546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:18.497740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:18.689126 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:18.701735 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:18.703651 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:18.705224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-07325b42-f998-4e19-8aa7-16d7e9714f4d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.230363 Sep 11 08:54:18.707084 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 460/940] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:18 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:18.932029 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:18.932730 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:18.939226 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:18.939677 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:18.940113 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:18.940802 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:18.941251 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:18.941683 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:18.955803 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] HTTP exception thrown: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Request method failure captured: Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 HTTP/1.1 Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaCEKxQm61HhkD1G3VxeGvmkxppEfvGwRWCWczWYviKu-xMPL-RWpAs1sdqFMUBuh3nY7ReczgkWXrER6Ser28oDMWdBqSdmTpLlv2Iw4VpNvzd4yIZUDciIF8qw5Nvj5sh0cILYkRc-i81PpJ0oxdkEg2C145MTYYO-_myVoUnRik4 Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:54:18.965742 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/347504c603af4937b829f24349b013c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_347504c603af4937b829f24349b013c2", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: 3abba619decf448db477533c663004bb Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:18.967963 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'd60e297f-d22d-4463-b9ed-d14b988add11'} Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:54:18.968870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:18.970524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:18.971894 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Returning 404 to user: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:54:18.971894 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-946f1242-00aa-4302-b0a3-4594a7763b33 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 404 len: 111 microversion: 2.1 time: 0.030943 Sep 11 08:54:18.971894 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 481/941] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:18 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:54:18.972173 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3fc7700f-aab3-4c91-9242-a7abf4ef980c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '.version_select at 0x7fb27ebd7670>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:19.074033 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3fc7700f-aab3-4c91-9242-a7abf4ef980c tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469132432" status: 202 len: 0 microversion: 2.1 time: 0.109384 Sep 11 08:54:19.074670 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 461/942] 10.222.0.44 () {58 vars in 1221 bytes} [Sun Sep 11 08:54:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1469132432 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:54:19.407519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e761f2b2-c039-4914-be9d-0ebf641cf6c6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:19.408156 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e761f2b2-c039-4914-be9d-0ebf641cf6c6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:19.414763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e761f2b2-c039-4914-be9d-0ebf641cf6c6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:19.415250 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e761f2b2-c039-4914-be9d-0ebf641cf6c6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:19.415687 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e761f2b2-c039-4914-be9d-0ebf641cf6c6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:19.416427 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e761f2b2-c039-4914-be9d-0ebf641cf6c6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:19.416880 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e761f2b2-c039-4914-be9d-0ebf641cf6c6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:19.417300 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e761f2b2-c039-4914-be9d-0ebf641cf6c6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:19.635655 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e761f2b2-c039-4914-be9d-0ebf641cf6c6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:19.644175 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e761f2b2-c039-4914-be9d-0ebf641cf6c6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.240628 Sep 11 08:54:19.644945 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 482/943] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:19 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:19.732819 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:19.733445 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:19.740432 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:19.740915 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:19.741375 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:19.742071 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:19.742606 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:19.743030 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:19.884738 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:19.893299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:19.894797 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:19.895969 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-837b8469-9ada-47dc-873a-1f63556c8a81 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.167644 Sep 11 08:54:19.896530 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 462/944] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:19 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:20.667608 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e5a54c08-2b91-4866-af9c-aa15e5091a4c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:20.668222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e5a54c08-2b91-4866-af9c-aa15e5091a4c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:20.675069 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5a54c08-2b91-4866-af9c-aa15e5091a4c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:20.675559 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5a54c08-2b91-4866-af9c-aa15e5091a4c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:20.675990 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5a54c08-2b91-4866-af9c-aa15e5091a4c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:20.676686 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5a54c08-2b91-4866-af9c-aa15e5091a4c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:20.677135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5a54c08-2b91-4866-af9c-aa15e5091a4c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:20.677556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5a54c08-2b91-4866-af9c-aa15e5091a4c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:20.847544 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e5a54c08-2b91-4866-af9c-aa15e5091a4c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:20.865366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e5a54c08-2b91-4866-af9c-aa15e5091a4c tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.201509 Sep 11 08:54:20.866312 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 483/945] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:20 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:20.923122 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:20.924299 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:20.933279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:20.933777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:20.934243 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:20.935007 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:20.935463 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:20.935885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:21.095294 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:21.104479 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:21.105955 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:21.107318 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b2c22b9b-0795-48ec-86e5-309044d32824 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.189414 Sep 11 08:54:21.107885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 463/946] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:20 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:21.892291 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d71c9023-e8e5-442a-9aa4-dfc4920b36f6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:21.892931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d71c9023-e8e5-442a-9aa4-dfc4920b36f6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:21.899571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d71c9023-e8e5-442a-9aa4-dfc4920b36f6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:21.900064 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d71c9023-e8e5-442a-9aa4-dfc4920b36f6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:21.900500 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d71c9023-e8e5-442a-9aa4-dfc4920b36f6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:21.901202 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d71c9023-e8e5-442a-9aa4-dfc4920b36f6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:21.901660 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d71c9023-e8e5-442a-9aa4-dfc4920b36f6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:21.902109 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d71c9023-e8e5-442a-9aa4-dfc4920b36f6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:22.048503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d71c9023-e8e5-442a-9aa4-dfc4920b36f6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:22.056236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d71c9023-e8e5-442a-9aa4-dfc4920b36f6 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.168657 Sep 11 08:54:22.056806 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 484/947] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:21 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:22.134627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:22.135212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:22.141620 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:22.142095 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:22.142606 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:22.143239 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:22.143687 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:22.144108 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:22.276664 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:22.285627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:22.287222 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:22.288434 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f49816e2-598d-498a-9c9d-478b54cb7f87 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.157713 Sep 11 08:54:22.289425 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 464/948] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:22 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:22.852641 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-fe2bcaf2-730a-4502-8326-d3e2d94314aa req-634f7511-8f7a-4815-b147-65222f900d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe", "name": "network-vif-plugged", "status": "completed", "tag": "2a26af6d-2714-450a-b99a-6e72dec54d7e"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:54:22.864192 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-fe2bcaf2-730a-4502-8326-d3e2d94314aa req-634f7511-8f7a-4815-b147-65222f900d2d service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:22.864761 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-fe2bcaf2-730a-4502-8326-d3e2d94314aa req-634f7511-8f7a-4815-b147-65222f900d2d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:22.865110 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-fe2bcaf2-730a-4502-8326-d3e2d94314aa req-634f7511-8f7a-4815-b147-65222f900d2d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:22.876957 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-fe2bcaf2-730a-4502-8326-d3e2d94314aa req-634f7511-8f7a-4815-b147-65222f900d2d service nova] Creating event network-vif-plugged:2a26af6d-2714-450a-b99a-6e72dec54d7e for instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe on hv-cinder-85694 Sep 11 08:54:22.882066 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-fe2bcaf2-730a-4502-8326-d3e2d94314aa req-634f7511-8f7a-4815-b147-65222f900d2d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033335 Sep 11 08:54:22.889189 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 485/949] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:54:23.081620 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-87e1e7f3-7c65-4e7b-938b-b438246de64a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:23.082451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-87e1e7f3-7c65-4e7b-938b-b438246de64a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:23.084512 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:23.089656 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87e1e7f3-7c65-4e7b-938b-b438246de64a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:23.090141 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87e1e7f3-7c65-4e7b-938b-b438246de64a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:23.091334 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87e1e7f3-7c65-4e7b-938b-b438246de64a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:23.092194 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87e1e7f3-7c65-4e7b-938b-b438246de64a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:23.092632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87e1e7f3-7c65-4e7b-938b-b438246de64a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:23.093055 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-87e1e7f3-7c65-4e7b-938b-b438246de64a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:23.239167 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-87e1e7f3-7c65-4e7b-938b-b438246de64a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:23.247507 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-87e1e7f3-7c65-4e7b-938b-b438246de64a tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.170922 Sep 11 08:54:23.248112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 465/950] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:23 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:23.318930 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:23.319783 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:23.326543 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:23.327060 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:23.327463 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:23.328166 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:23.328625 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:23.329041 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:23.508782 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:23.517108 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:23.518609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:23.519796 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d248c5a3-9691-4f21-9186-5192f249ad0f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.205960 Sep 11 08:54:23.520364 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 486/951] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:23 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:23.665563 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:23.666066 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:23.673047 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:23.673544 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:23.674024 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:23.675304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:23.676116 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:23.677426 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:23.693077 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] HTTP exception thrown: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Request method failure captured: Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: DELETE /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 HTTP/1.1 Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaCEKxQm61HhkD1G3VxeGvmkxppEfvGwRWCWczWYviKu-xMPL-RWpAs1sdqFMUBuh3nY7ReczgkWXrER6Ser28oDMWdBqSdmTpLlv2Iw4VpNvzd4yIZUDciIF8qw5Nvj5sh0cILYkRc-i81PpJ0oxdkEg2C145MTYYO-_myVoUnRik4 Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:54:23.694826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/347504c603af4937b829f24349b013c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_347504c603af4937b829f24349b013c2", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 3abba619decf448db477533c663004bb Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:23.696450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'd60e297f-d22d-4463-b9ed-d14b988add11'} Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:54:23.697452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:23.699056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:54:23.700739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Returning 404 to user: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:54:23.700739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3858ded4-ecd8-49ad-b206-d4d33680e5b7 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 404 len: 111 microversion: 2.1 time: 0.034549 Sep 11 08:54:23.700739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 466/952] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:54:23 2022] DELETE /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:54:23.706139 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:23.706813 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: d60e297f-d22d-4463-b9ed-d14b988add11] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:23.712873 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:23.713353 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:23.713785 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:23.714516 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:23.714970 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:23.715392 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:23.728885 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] HTTP exception thrown: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Request method failure captured: Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 HTTP/1.1 Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaCEKxQm61HhkD1G3VxeGvmkxppEfvGwRWCWczWYviKu-xMPL-RWpAs1sdqFMUBuh3nY7ReczgkWXrER6Ser28oDMWdBqSdmTpLlv2Iw4VpNvzd4yIZUDciIF8qw5Nvj5sh0cILYkRc-i81PpJ0oxdkEg2C145MTYYO-_myVoUnRik4 Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:54:23.730596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/347504c603af4937b829f24349b013c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_347504c603af4937b829f24349b013c2", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: 3abba619decf448db477533c663004bb Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:23.732787 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'd60e297f-d22d-4463-b9ed-d14b988add11'} Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:54:23.733606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. Sep 11 08:54:23.735103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:23.736178 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Returning 404 to user: Instance d60e297f-d22d-4463-b9ed-d14b988add11 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:54:23.736178 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ae23a444-a6d0-4375-a52a-970eb5af072a tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11" status: 404 len: 111 microversion: 2.1 time: 0.031321 Sep 11 08:54:23.736178 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 487/953] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:23 2022] GET /compute/v2.1/servers/d60e297f-d22d-4463-b9ed-d14b988add11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:54:24.271519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-72c4a660-00a1-4cca-b517-b674f630d9bb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:24.272143 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-72c4a660-00a1-4cca-b517-b674f630d9bb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:24.278921 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72c4a660-00a1-4cca-b517-b674f630d9bb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:24.279419 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72c4a660-00a1-4cca-b517-b674f630d9bb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:24.279964 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72c4a660-00a1-4cca-b517-b674f630d9bb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:24.280690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72c4a660-00a1-4cca-b517-b674f630d9bb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:24.281153 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72c4a660-00a1-4cca-b517-b674f630d9bb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:24.281679 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-72c4a660-00a1-4cca-b517-b674f630d9bb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:24.458084 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-72c4a660-00a1-4cca-b517-b674f630d9bb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:24.472645 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-72c4a660-00a1-4cca-b517-b674f630d9bb tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.204746 Sep 11 08:54:24.473710 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 467/954] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:24 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:24.545729 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:24.546417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:24.553137 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:24.553625 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:24.554057 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:24.554786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:24.555299 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:24.555725 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:24.695738 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:24.710047 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:24.711483 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:24.713281 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-10ed3e78-bec5-4c13-a78c-e0799f5a19e9 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.171722 Sep 11 08:54:24.713281 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 488/955] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:24 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:25.042527 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:25.047402 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:25.050721 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:25.051217 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:25.051729 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:25.052577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:25.053196 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:25.053697 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:25.070202 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] HTTP exception thrown: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Request method failure captured: Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: DELETE /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e HTTP/1.1 Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaCEKxQm61HhkD1G3VxeGvmkxppEfvGwRWCWczWYviKu-xMPL-RWpAs1sdqFMUBuh3nY7ReczgkWXrER6Ser28oDMWdBqSdmTpLlv2Iw4VpNvzd4yIZUDciIF8qw5Nvj5sh0cILYkRc-i81PpJ0oxdkEg2C145MTYYO-_myVoUnRik4 Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:54:25.073015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/347504c603af4937b829f24349b013c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_347504c603af4937b829f24349b013c2", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 3abba619decf448db477533c663004bb Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:54:25.074417 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': '1185ff5c-f369-4602-8e3e-c4a1438ed06e'} Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:54:25.075832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:54:25.077722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:54:25.079629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Returning 404 to user: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:54:25.079629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-81a6b5a6-3e76-4ad8-823f-be107f6fe29f tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 404 len: 111 microversion: 2.1 time: 0.036228 Sep 11 08:54:25.079629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 468/956] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:54:25 2022] DELETE /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:54:25.083785 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:25.084602 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] [instance: 1185ff5c-f369-4602-8e3e-c4a1438ed06e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:25.090683 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:25.091697 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:25.092135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:25.093046 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:25.093504 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:25.093934 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:25.108145 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] HTTP exception thrown: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Request method failure captured: Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e HTTP/1.1 Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaCEKxQm61HhkD1G3VxeGvmkxppEfvGwRWCWczWYviKu-xMPL-RWpAs1sdqFMUBuh3nY7ReczgkWXrER6Ser28oDMWdBqSdmTpLlv2Iw4VpNvzd4yIZUDciIF8qw5Nvj5sh0cILYkRc-i81PpJ0oxdkEg2C145MTYYO-_myVoUnRik4 Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:54:25.109693 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/347504c603af4937b829f24349b013c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/347504c603af4937b829f24349b013c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_347504c603af4937b829f24349b013c2", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 347504c603af4937b829f24349b013c2 Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-450099151 Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: 3abba619decf448db477533c663004bb Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeTestJSON-450099151-project Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:54:25.111377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': '1185ff5c-f369-4602-8e3e-c4a1438ed06e'} Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:54:25.112366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. Sep 11 08:54:25.113714 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:54:25.118091 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] Returning 404 to user: Instance 1185ff5c-f369-4602-8e3e-c4a1438ed06e could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:54:25.118091 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2252dd9f-e140-41fc-96a0-10c0917a8f37 tempest-AttachVolumeTestJSON-450099151 tempest-AttachVolumeTestJSON-450099151-project] 10.222.0.44 "GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e" status: 404 len: 111 microversion: 2.1 time: 0.031511 Sep 11 08:54:25.118091 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 489/957] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:25 2022] GET /compute/v2.1/servers/1185ff5c-f369-4602-8e3e-c4a1438ed06e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:54:25.498426 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-aa20162e-d7b2-4d99-86af-885be9a9d502 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:25.499143 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-aa20162e-d7b2-4d99-86af-885be9a9d502 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:25.505726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa20162e-d7b2-4d99-86af-885be9a9d502 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:25.506258 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa20162e-d7b2-4d99-86af-885be9a9d502 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:25.506692 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa20162e-d7b2-4d99-86af-885be9a9d502 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:25.507396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa20162e-d7b2-4d99-86af-885be9a9d502 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:25.507849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa20162e-d7b2-4d99-86af-885be9a9d502 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:25.508268 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa20162e-d7b2-4d99-86af-885be9a9d502 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:25.669508 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-aa20162e-d7b2-4d99-86af-885be9a9d502 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:25.683519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-aa20162e-d7b2-4d99-86af-885be9a9d502 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.190013 Sep 11 08:54:25.685465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 469/958] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:25 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:25.748572 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:25.749237 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:25.755766 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:25.756265 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:25.756707 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:25.757424 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:25.757941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:25.758397 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:26.015205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:26.023769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:26.025347 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:26.026596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-fecdf933-f033-4199-84d3-8076e211e45e tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1728 microversion: 2.20 time: 0.282256 Sep 11 08:54:26.027161 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 490/959] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:25 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1728 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:26.162549 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-81fd562e-594c-4ad1-81d0-680e1a1b4859 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:26.162951 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-81fd562e-594c-4ad1-81d0-680e1a1b4859 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:26.170949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd562e-594c-4ad1-81d0-680e1a1b4859 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:26.171442 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd562e-594c-4ad1-81d0-680e1a1b4859 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:26.171878 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd562e-594c-4ad1-81d0-680e1a1b4859 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:26.172632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd562e-594c-4ad1-81d0-680e1a1b4859 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:26.173302 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd562e-594c-4ad1-81d0-680e1a1b4859 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:26.173730 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81fd562e-594c-4ad1-81d0-680e1a1b4859 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:26.190202 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=100 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:26.200566 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-81fd562e-594c-4ad1-81d0-680e1a1b4859 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/ips" status: 200 len: 149 microversion: 2.1 time: 0.042017 Sep 11 08:54:26.202031 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 470/960] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 08:54:26 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:54:26.709040 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b5f64358-3b25-44ec-9107-379c3ed0bd66 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:26.709844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b5f64358-3b25-44ec-9107-379c3ed0bd66 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:26.719992 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5f64358-3b25-44ec-9107-379c3ed0bd66 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:26.720879 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5f64358-3b25-44ec-9107-379c3ed0bd66 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:26.722845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5f64358-3b25-44ec-9107-379c3ed0bd66 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:26.724153 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5f64358-3b25-44ec-9107-379c3ed0bd66 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:26.725012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5f64358-3b25-44ec-9107-379c3ed0bd66 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:26.725453 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b5f64358-3b25-44ec-9107-379c3ed0bd66 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:26.979304 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b5f64358-3b25-44ec-9107-379c3ed0bd66 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:26.991317 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b5f64358-3b25-44ec-9107-379c3ed0bd66 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.286076 Sep 11 08:54:26.992012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 491/961] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:26 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:27.053481 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:27.054237 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:27.060680 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:27.061448 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:27.061916 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:27.062644 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:27.063104 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:27.063623 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:27.229057 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:27.239171 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:27.240633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:27.241863 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-35cabbde-f943-424b-92a1-56ea4a17828f tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1715 microversion: 2.20 time: 0.192835 Sep 11 08:54:27.242443 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 471/962] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:54:27 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1715 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:54:28.015653 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-45d18e32-bbf1-4e30-85b2-781914ac1063 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:28.018964 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-45d18e32-bbf1-4e30-85b2-781914ac1063 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:28.031929 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45d18e32-bbf1-4e30-85b2-781914ac1063 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:28.032827 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45d18e32-bbf1-4e30-85b2-781914ac1063 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:28.033460 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45d18e32-bbf1-4e30-85b2-781914ac1063 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:28.034459 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45d18e32-bbf1-4e30-85b2-781914ac1063 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:28.035089 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45d18e32-bbf1-4e30-85b2-781914ac1063 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:28.036960 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-45d18e32-bbf1-4e30-85b2-781914ac1063 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:28.080100 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-feefff92-f37a-4d3e-b96e-4eda03054c53 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bee0b579-7419-41a1-a19d-bf0006c090d7"}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:54:28.082568 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-feefff92-f37a-4d3e-b96e-4eda03054c53 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:28.091352 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-feefff92-f37a-4d3e-b96e-4eda03054c53 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:28.091851 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-feefff92-f37a-4d3e-b96e-4eda03054c53 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:28.092280 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-feefff92-f37a-4d3e-b96e-4eda03054c53 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:28.093000 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-feefff92-f37a-4d3e-b96e-4eda03054c53 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:28.093605 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-feefff92-f37a-4d3e-b96e-4eda03054c53 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:28.093991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-feefff92-f37a-4d3e-b96e-4eda03054c53 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:28.333140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-45d18e32-bbf1-4e30-85b2-781914ac1063 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:28.341972 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-45d18e32-bbf1-4e30-85b2-781914ac1063 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.330727 Sep 11 08:54:28.342593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 492/963] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:28 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:28.927767 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-bd167fe1-05b0-4a08-a209-2b9f0b14ac46 req-4ef97acc-30cc-47dd-b87c-d1dd9d4b2d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c90788-7f2f-48f0-bdcb-1b66a5c48f8b", "name": "network-vif-plugged", "status": "completed", "tag": "d9c7e947-ce3e-4ea3-8867-16f246a7639b"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:54:28.939168 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-bd167fe1-05b0-4a08-a209-2b9f0b14ac46 req-4ef97acc-30cc-47dd-b87c-d1dd9d4b2d93 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:28.940001 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-bd167fe1-05b0-4a08-a209-2b9f0b14ac46 req-4ef97acc-30cc-47dd-b87c-d1dd9d4b2d93 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:28.940625 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-bd167fe1-05b0-4a08-a209-2b9f0b14ac46 req-4ef97acc-30cc-47dd-b87c-d1dd9d4b2d93 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:28.944028 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=100 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:28.960247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-bd167fe1-05b0-4a08-a209-2b9f0b14ac46 req-4ef97acc-30cc-47dd-b87c-d1dd9d4b2d93 service nova] Creating event network-vif-plugged:d9c7e947-ce3e-4ea3-8867-16f246a7639b for instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b on hv-cinder-85694 Sep 11 08:54:28.968336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-bd167fe1-05b0-4a08-a209-2b9f0b14ac46 req-4ef97acc-30cc-47dd-b87c-d1dd9d4b2d93 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044582 Sep 11 08:54:28.971197 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 493/964] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:54:29.097492 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-feefff92-f37a-4d3e-b96e-4eda03054c53 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.021043 Sep 11 08:54:29.102421 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 472/965] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:54:28 2022] POST /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-volume_attachments => generated 194 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:54:29.370310 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-56f9664a-1a89-44c6-8057-22bf19691706 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:29.372619 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-56f9664a-1a89-44c6-8057-22bf19691706 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:29.382039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56f9664a-1a89-44c6-8057-22bf19691706 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:29.382659 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56f9664a-1a89-44c6-8057-22bf19691706 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:29.383093 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56f9664a-1a89-44c6-8057-22bf19691706 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:29.384267 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56f9664a-1a89-44c6-8057-22bf19691706 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:29.384736 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56f9664a-1a89-44c6-8057-22bf19691706 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:29.388036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56f9664a-1a89-44c6-8057-22bf19691706 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:29.703798 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-56f9664a-1a89-44c6-8057-22bf19691706 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:29.711788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-56f9664a-1a89-44c6-8057-22bf19691706 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.348109 Sep 11 08:54:29.712370 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 494/966] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:29 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:30.740760 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-08495e51-27c4-4ce8-9fb0-6a622dad1345 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:30.741473 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-08495e51-27c4-4ce8-9fb0-6a622dad1345 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:30.749673 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08495e51-27c4-4ce8-9fb0-6a622dad1345 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:30.750192 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08495e51-27c4-4ce8-9fb0-6a622dad1345 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:30.750641 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08495e51-27c4-4ce8-9fb0-6a622dad1345 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:30.751354 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08495e51-27c4-4ce8-9fb0-6a622dad1345 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:30.751815 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08495e51-27c4-4ce8-9fb0-6a622dad1345 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:30.752697 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-08495e51-27c4-4ce8-9fb0-6a622dad1345 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:30.897062 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-08495e51-27c4-4ce8-9fb0-6a622dad1345 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:30.906783 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-08495e51-27c4-4ce8-9fb0-6a622dad1345 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1577 microversion: 2.1 time: 0.171134 Sep 11 08:54:30.911191 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 473/967] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:30 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:31.931811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0bafc335-b170-4264-abaf-5c167be4e6a2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:31.932638 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0bafc335-b170-4264-abaf-5c167be4e6a2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:31.939250 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bafc335-b170-4264-abaf-5c167be4e6a2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:31.939729 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bafc335-b170-4264-abaf-5c167be4e6a2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:31.940159 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bafc335-b170-4264-abaf-5c167be4e6a2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:31.940888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bafc335-b170-4264-abaf-5c167be4e6a2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:31.941305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bafc335-b170-4264-abaf-5c167be4e6a2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:31.941793 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0bafc335-b170-4264-abaf-5c167be4e6a2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:32.080556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0bafc335-b170-4264-abaf-5c167be4e6a2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:32.088399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0bafc335-b170-4264-abaf-5c167be4e6a2 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1564 microversion: 2.1 time: 0.161236 Sep 11 08:54:32.088984 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 495/968] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:31 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:36.682403 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bf48e4d1-10ed-45c5-a14b-f411da1f6499 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: .version_select at 0x7fb27eb86c10>, body: {"keypair": {"name": "tempest-keypair-882350265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAcPET9KeqC9GA9G6BbIJFRTD74t1D6lhvGWpCCrcpAbxtSJZa+svXMeTf5M81VSPKAq89cuUu6Ig1IIHgTkJ61raw4lHKOkb4kNHVuOvr2HEWJx3Nt+oFuD/ADzuWsGQ=="}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:54:36.698795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-bf48e4d1-10ed-45c5-a14b-f411da1f6499 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for project c0401850bdf44aaaa6c37ed752708f53. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:54:36.702637 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-bf48e4d1-10ed-45c5-a14b-f411da1f6499 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for user c1c1de0489104713a90c59b89a284321 and project c0401850bdf44aaaa6c37ed752708f53. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:54:36.824824 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bf48e4d1-10ed-45c5-a14b-f411da1f6499 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146241 Sep 11 08:54:36.825756 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 474/969] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 08:54:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:54:39.627261 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1908703831", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14f105a2-32ea-4014-a77a-841402520d71"}], "security_groups": [{"name": "tempest-securitygroup--1238408506"}], "key_name": "tempest-keypair-882350265", "user_data": "}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:54:39.745476 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] validate_networks() for [('14f105a2-32ea-4014-a77a-841402520d71', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:54:40.146477 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:54:40.146908 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:54:40.147388 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:54:40.147815 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:54:40.148220 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:54:40.150463 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=65 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:40.158877 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:40.159331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:40.161053 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:40.162807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:40.162807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:40.164826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:40.188088 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for project c0401850bdf44aaaa6c37ed752708f53. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:54:40.193099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for user c1c1de0489104713a90c59b89a284321 and project c0401850bdf44aaaa6c37ed752708f53. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:54:40.207177 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:54:40.209970 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:54:40.401151 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d0a03131-1c18-4287-ac3e-cd76fe0c2c95 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.779314 Sep 11 08:54:40.402087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 496/970] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:54:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:54:40.421330 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4b1c4059-5523-45d4-9022-a6c5fef14df2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:40.422250 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4b1c4059-5523-45d4-9022-a6c5fef14df2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:40.500008 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4b1c4059-5523-45d4-9022-a6c5fef14df2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:40.510607 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4b1c4059-5523-45d4-9022-a6c5fef14df2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1241 microversion: 2.1 time: 0.095341 Sep 11 08:54:40.511200 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 475/971] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:40 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:54:41.541746 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3fd2f06e-a448-43e5-b8bc-3fa226be689b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:41.542409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3fd2f06e-a448-43e5-b8bc-3fa226be689b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:41.551644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3fd2f06e-a448-43e5-b8bc-3fa226be689b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:41.551644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3fd2f06e-a448-43e5-b8bc-3fa226be689b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:41.552345 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3fd2f06e-a448-43e5-b8bc-3fa226be689b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:41.553821 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3fd2f06e-a448-43e5-b8bc-3fa226be689b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:41.554694 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3fd2f06e-a448-43e5-b8bc-3fa226be689b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:41.555135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3fd2f06e-a448-43e5-b8bc-3fa226be689b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:41.626362 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3fd2f06e-a448-43e5-b8bc-3fa226be689b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:41.640924 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3fd2f06e-a448-43e5-b8bc-3fa226be689b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1245 microversion: 2.1 time: 0.099372 Sep 11 08:54:41.640924 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 497/972] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:41 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:42.661371 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-24b66cb8-19ee-4280-9bae-0616e0d48ab0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:42.661948 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-24b66cb8-19ee-4280-9bae-0616e0d48ab0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:42.664022 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:42.669732 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24b66cb8-19ee-4280-9bae-0616e0d48ab0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:42.670292 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24b66cb8-19ee-4280-9bae-0616e0d48ab0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:42.670739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24b66cb8-19ee-4280-9bae-0616e0d48ab0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:42.671440 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24b66cb8-19ee-4280-9bae-0616e0d48ab0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:42.671894 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24b66cb8-19ee-4280-9bae-0616e0d48ab0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:42.672317 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24b66cb8-19ee-4280-9bae-0616e0d48ab0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:42.739114 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-24b66cb8-19ee-4280-9bae-0616e0d48ab0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:42.746853 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-24b66cb8-19ee-4280-9bae-0616e0d48ab0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1293 microversion: 2.1 time: 0.089581 Sep 11 08:54:42.747588 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 476/973] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:42 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:43.772302 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-56692a92-2f8e-48ed-b558-3724f0aeadf7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:43.773293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-56692a92-2f8e-48ed-b558-3724f0aeadf7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:43.780412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56692a92-2f8e-48ed-b558-3724f0aeadf7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:43.781020 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56692a92-2f8e-48ed-b558-3724f0aeadf7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:43.781528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56692a92-2f8e-48ed-b558-3724f0aeadf7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:43.782355 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56692a92-2f8e-48ed-b558-3724f0aeadf7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:43.782903 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56692a92-2f8e-48ed-b558-3724f0aeadf7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:43.783338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56692a92-2f8e-48ed-b558-3724f0aeadf7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:43.855684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-56692a92-2f8e-48ed-b558-3724f0aeadf7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:43.864219 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-56692a92-2f8e-48ed-b558-3724f0aeadf7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1299 microversion: 2.1 time: 0.096363 Sep 11 08:54:43.864820 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 498/974] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:43 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:44.887725 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3a32f4c3-95ab-48d5-9e27-468e13448d10 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:44.889705 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3a32f4c3-95ab-48d5-9e27-468e13448d10 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:44.897498 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a32f4c3-95ab-48d5-9e27-468e13448d10 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:44.898102 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a32f4c3-95ab-48d5-9e27-468e13448d10 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:44.898646 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a32f4c3-95ab-48d5-9e27-468e13448d10 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:44.899360 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a32f4c3-95ab-48d5-9e27-468e13448d10 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:44.899826 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a32f4c3-95ab-48d5-9e27-468e13448d10 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:44.900249 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3a32f4c3-95ab-48d5-9e27-468e13448d10 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:45.015702 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-50a52983-1a4b-4045-a070-d5f8b052c2db req-2042a447-b71b-492c-a5a9-7e2b3c911cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff049257-22d8-414c-9ad2-c5e2c33470b9", "tag": "7d6625ab-b5cb-4863-aadc-c5f604a200c0"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:54:45.026899 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-50a52983-1a4b-4045-a070-d5f8b052c2db req-2042a447-b71b-492c-a5a9-7e2b3c911cb4 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:45.027385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-50a52983-1a4b-4045-a070-d5f8b052c2db req-2042a447-b71b-492c-a5a9-7e2b3c911cb4 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:45.027968 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-50a52983-1a4b-4045-a070-d5f8b052c2db req-2042a447-b71b-492c-a5a9-7e2b3c911cb4 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:45.039678 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-50a52983-1a4b-4045-a070-d5f8b052c2db req-2042a447-b71b-492c-a5a9-7e2b3c911cb4 service nova] Creating event network-changed:7d6625ab-b5cb-4863-aadc-c5f604a200c0 for instance ff049257-22d8-414c-9ad2-c5e2c33470b9 on hv-cinder-85694 Sep 11 08:54:45.045011 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-50a52983-1a4b-4045-a070-d5f8b052c2db req-2042a447-b71b-492c-a5a9-7e2b3c911cb4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033793 Sep 11 08:54:45.045939 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 499/975] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:54:45.056392 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3a32f4c3-95ab-48d5-9e27-468e13448d10 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:45.073345 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3a32f4c3-95ab-48d5-9e27-468e13448d10 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1367 microversion: 2.1 time: 0.181636 Sep 11 08:54:45.073345 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 477/976] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:44 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:46.091451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f2a596d7-3627-4777-bed1-69d1b398cb74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:46.092422 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f2a596d7-3627-4777-bed1-69d1b398cb74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:46.099574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2a596d7-3627-4777-bed1-69d1b398cb74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:46.100136 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2a596d7-3627-4777-bed1-69d1b398cb74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:46.100588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2a596d7-3627-4777-bed1-69d1b398cb74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:46.101295 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2a596d7-3627-4777-bed1-69d1b398cb74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:46.101752 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2a596d7-3627-4777-bed1-69d1b398cb74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:46.102206 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f2a596d7-3627-4777-bed1-69d1b398cb74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:46.253564 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f2a596d7-3627-4777-bed1-69d1b398cb74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:46.257572 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f2a596d7-3627-4777-bed1-69d1b398cb74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1367 microversion: 2.1 time: 0.171445 Sep 11 08:54:46.258394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 500/977] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:46 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:47.283887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3822f615-2429-4f1c-ac43-cf92aacbda81 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:47.284458 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3822f615-2429-4f1c-ac43-cf92aacbda81 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:47.291035 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3822f615-2429-4f1c-ac43-cf92aacbda81 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:47.291517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3822f615-2429-4f1c-ac43-cf92aacbda81 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:47.292115 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3822f615-2429-4f1c-ac43-cf92aacbda81 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:47.292896 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3822f615-2429-4f1c-ac43-cf92aacbda81 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:47.293352 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3822f615-2429-4f1c-ac43-cf92aacbda81 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:47.293770 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3822f615-2429-4f1c-ac43-cf92aacbda81 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:47.466938 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3822f615-2429-4f1c-ac43-cf92aacbda81 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:47.475359 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3822f615-2429-4f1c-ac43-cf92aacbda81 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1367 microversion: 2.1 time: 0.196331 Sep 11 08:54:47.478949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 478/978] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:47 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:48.500268 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-56c183bc-a7ac-44ae-a599-3596dcfd35bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:48.500861 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-56c183bc-a7ac-44ae-a599-3596dcfd35bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:48.507909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56c183bc-a7ac-44ae-a599-3596dcfd35bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:48.508399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56c183bc-a7ac-44ae-a599-3596dcfd35bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:48.508879 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56c183bc-a7ac-44ae-a599-3596dcfd35bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:48.509614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56c183bc-a7ac-44ae-a599-3596dcfd35bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:48.510063 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56c183bc-a7ac-44ae-a599-3596dcfd35bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:48.510517 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-56c183bc-a7ac-44ae-a599-3596dcfd35bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:48.668480 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-56c183bc-a7ac-44ae-a599-3596dcfd35bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:48.677237 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-56c183bc-a7ac-44ae-a599-3596dcfd35bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1367 microversion: 2.1 time: 0.181134 Sep 11 08:54:48.678025 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 501/979] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:48 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:49.700991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2cffd601-4b06-491e-b69e-9e9764dfca3f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:49.701588 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2cffd601-4b06-491e-b69e-9e9764dfca3f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:49.708599 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2cffd601-4b06-491e-b69e-9e9764dfca3f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:49.709327 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2cffd601-4b06-491e-b69e-9e9764dfca3f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:49.709763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2cffd601-4b06-491e-b69e-9e9764dfca3f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:49.710502 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2cffd601-4b06-491e-b69e-9e9764dfca3f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:49.710958 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2cffd601-4b06-491e-b69e-9e9764dfca3f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:49.711384 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2cffd601-4b06-491e-b69e-9e9764dfca3f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:49.861884 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2cffd601-4b06-491e-b69e-9e9764dfca3f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:49.872861 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2cffd601-4b06-491e-b69e-9e9764dfca3f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1367 microversion: 2.1 time: 0.175606 Sep 11 08:54:49.873452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 479/980] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:49 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:50.906205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e5bc510b-c523-4973-9698-c1eb4776ecdd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:50.906205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e5bc510b-c523-4973-9698-c1eb4776ecdd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:50.906205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:50.906205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=6 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:50.907425 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5bc510b-c523-4973-9698-c1eb4776ecdd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:50.908054 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5bc510b-c523-4973-9698-c1eb4776ecdd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:50.908588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5bc510b-c523-4973-9698-c1eb4776ecdd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:50.909429 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5bc510b-c523-4973-9698-c1eb4776ecdd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:50.910191 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5bc510b-c523-4973-9698-c1eb4776ecdd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:50.910435 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e5bc510b-c523-4973-9698-c1eb4776ecdd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:51.060743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e5bc510b-c523-4973-9698-c1eb4776ecdd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:51.068804 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e5bc510b-c523-4973-9698-c1eb4776ecdd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1367 microversion: 2.1 time: 0.175040 Sep 11 08:54:51.069365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 502/981] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:50 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:51.163555 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-70d0b5c5-1f80-4570-97d6-1ff226c5e543 req-ce0befd0-d609-4f6d-b9d3-c9120ec02d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff049257-22d8-414c-9ad2-c5e2c33470b9", "name": "network-vif-plugged", "status": "completed", "tag": "7d6625ab-b5cb-4863-aadc-c5f604a200c0"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:54:51.171466 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=6 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:51.181766 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-70d0b5c5-1f80-4570-97d6-1ff226c5e543 req-ce0befd0-d609-4f6d-b9d3-c9120ec02d4d service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:51.182453 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-70d0b5c5-1f80-4570-97d6-1ff226c5e543 req-ce0befd0-d609-4f6d-b9d3-c9120ec02d4d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:51.182986 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-70d0b5c5-1f80-4570-97d6-1ff226c5e543 req-ce0befd0-d609-4f6d-b9d3-c9120ec02d4d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:51.195785 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-70d0b5c5-1f80-4570-97d6-1ff226c5e543 req-ce0befd0-d609-4f6d-b9d3-c9120ec02d4d service nova] Creating event network-vif-plugged:7d6625ab-b5cb-4863-aadc-c5f604a200c0 for instance ff049257-22d8-414c-9ad2-c5e2c33470b9 on hv-cinder-85694 Sep 11 08:54:51.201018 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-70d0b5c5-1f80-4570-97d6-1ff226c5e543 req-ce0befd0-d609-4f6d-b9d3-c9120ec02d4d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043360 Sep 11 08:54:51.202264 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 480/982] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:54:52.092520 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-10e85390-bd62-429b-9b90-38f2efa79938 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:52.093151 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-10e85390-bd62-429b-9b90-38f2efa79938 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:52.099886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10e85390-bd62-429b-9b90-38f2efa79938 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:52.100376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10e85390-bd62-429b-9b90-38f2efa79938 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:52.100813 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10e85390-bd62-429b-9b90-38f2efa79938 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:52.101519 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10e85390-bd62-429b-9b90-38f2efa79938 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:52.101972 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10e85390-bd62-429b-9b90-38f2efa79938 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:52.102420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-10e85390-bd62-429b-9b90-38f2efa79938 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:52.266888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-10e85390-bd62-429b-9b90-38f2efa79938 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:52.275488 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-10e85390-bd62-429b-9b90-38f2efa79938 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1367 microversion: 2.1 time: 0.187450 Sep 11 08:54:52.276096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 503/983] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:52 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:53.310674 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bce6d095-2987-4e64-8f09-2c8fafd74585 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:53.311381 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bce6d095-2987-4e64-8f09-2c8fafd74585 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:53.318551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bce6d095-2987-4e64-8f09-2c8fafd74585 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:53.320559 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bce6d095-2987-4e64-8f09-2c8fafd74585 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:53.320559 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bce6d095-2987-4e64-8f09-2c8fafd74585 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:53.320559 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bce6d095-2987-4e64-8f09-2c8fafd74585 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:53.320863 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bce6d095-2987-4e64-8f09-2c8fafd74585 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:53.321026 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-bce6d095-2987-4e64-8f09-2c8fafd74585 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:53.458307 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bce6d095-2987-4e64-8f09-2c8fafd74585 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:54:53.466075 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bce6d095-2987-4e64-8f09-2c8fafd74585 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1557 microversion: 2.1 time: 0.161725 Sep 11 08:54:53.466675 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 481/984] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:54:53 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:54:53.490222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-85bceda7-6613-4fca-ba67-dcb3bae08299 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:54:53.490718 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-85bceda7-6613-4fca-ba67-dcb3bae08299 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:54:53.497107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85bceda7-6613-4fca-ba67-dcb3bae08299 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:53.497593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85bceda7-6613-4fca-ba67-dcb3bae08299 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:53.498061 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85bceda7-6613-4fca-ba67-dcb3bae08299 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:53.499299 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85bceda7-6613-4fca-ba67-dcb3bae08299 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:53.499299 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85bceda7-6613-4fca-ba67-dcb3bae08299 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:53.499681 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-85bceda7-6613-4fca-ba67-dcb3bae08299 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:53.596254 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-85bceda7-6613-4fca-ba67-dcb3bae08299 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110500 Sep 11 08:54:53.597283 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 504/985] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 08:54:53 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:54:54.741401 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-b9ce0b96-b615-4f48-935f-bea2d2eb6f2e req-27e1983a-f59d-43bc-9476-0729200983d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff049257-22d8-414c-9ad2-c5e2c33470b9", "tag": "7d6625ab-b5cb-4863-aadc-c5f604a200c0"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:54:54.747110 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:54:54.752628 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-b9ce0b96-b615-4f48-935f-bea2d2eb6f2e req-27e1983a-f59d-43bc-9476-0729200983d3 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:54:54.753263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-b9ce0b96-b615-4f48-935f-bea2d2eb6f2e req-27e1983a-f59d-43bc-9476-0729200983d3 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:54:54.753779 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-b9ce0b96-b615-4f48-935f-bea2d2eb6f2e req-27e1983a-f59d-43bc-9476-0729200983d3 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:54:54.765182 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-b9ce0b96-b615-4f48-935f-bea2d2eb6f2e req-27e1983a-f59d-43bc-9476-0729200983d3 service nova] Creating event network-changed:7d6625ab-b5cb-4863-aadc-c5f604a200c0 for instance ff049257-22d8-414c-9ad2-c5e2c33470b9 on hv-cinder-85694 Sep 11 08:54:54.770526 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-b9ce0b96-b615-4f48-935f-bea2d2eb6f2e req-27e1983a-f59d-43bc-9476-0729200983d3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032754 Sep 11 08:54:54.771227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 482/986] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:55:00.842061 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-386979f3-36e4-48a2-b6a6-c78f4d85e9f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:00.844854 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-386979f3-36e4-48a2-b6a6-c78f4d85e9f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:00.855778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-386979f3-36e4-48a2-b6a6-c78f4d85e9f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:00.858439 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-386979f3-36e4-48a2-b6a6-c78f4d85e9f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:00.858439 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-386979f3-36e4-48a2-b6a6-c78f4d85e9f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:00.858439 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-386979f3-36e4-48a2-b6a6-c78f4d85e9f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:00.858439 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-386979f3-36e4-48a2-b6a6-c78f4d85e9f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:00.859409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-386979f3-36e4-48a2-b6a6-c78f4d85e9f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:00.861860 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=58 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:00.891138 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-386979f3-36e4-48a2-b6a6-c78f4d85e9f5 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053533 Sep 11 08:55:00.891739 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 505/987] 10.222.0.44 () {60 vars in 1343 bytes} [Sun Sep 11 08:55:00 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:00.965627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b6ae111c-43ff-4932-9c84-77d0908269f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:00.966328 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b6ae111c-43ff-4932-9c84-77d0908269f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:00.973658 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6ae111c-43ff-4932-9c84-77d0908269f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:00.974153 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6ae111c-43ff-4932-9c84-77d0908269f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:00.974598 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6ae111c-43ff-4932-9c84-77d0908269f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:00.975286 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6ae111c-43ff-4932-9c84-77d0908269f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:00.975918 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6ae111c-43ff-4932-9c84-77d0908269f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:00.976349 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6ae111c-43ff-4932-9c84-77d0908269f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:01.003647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b6ae111c-43ff-4932-9c84-77d0908269f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:55:01.300795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b6ae111c-43ff-4932-9c84-77d0908269f8 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 204 len: 0 microversion: 2.20 time: 0.339809 Sep 11 08:55:01.301431 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 483/988] 10.222.0.44 () {60 vars in 1280 bytes} [Sun Sep 11 08:55:00 2022] DELETE /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 08:55:01.310457 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:01.311103 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:01.317897 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:01.318405 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:01.318843 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:01.319541 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:01.319996 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:01.320544 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:01.452149 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:01.460936 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:01.462409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:01.463640 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-539a1836-eecc-4d7d-a108-55c8f8c05470 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.157627 Sep 11 08:55:01.464202 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 506/989] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:55:01 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:55:02.490037 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:02.491003 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:02.497498 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:02.498252 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:02.498686 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:02.499451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:02.499888 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:02.500310 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:02.651259 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:02.660187 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:02.661617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:02.662839 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-19c80a0a-f024-4cc9-9ecb-52edad2b2e5a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1721 microversion: 2.20 time: 0.177519 Sep 11 08:55:02.663400 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 484/990] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:55:02 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:55:03.694202 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:03.694817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:03.701609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:03.702326 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:03.702783 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:03.703503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:03.703968 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:03.704404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:03.789622 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:03.799011 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:03.800634 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:03.801909 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0ce0c558-bc8d-4f11-8082-d47b795998af tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1655 microversion: 2.20 time: 0.117026 Sep 11 08:55:03.802515 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 507/991] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:55:03 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1655 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:55:04.007208 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-854e91d8-46c3-4b31-bb47-465b8fa1dfc1 req-48f58643-0856-4d8f-8aa8-a50c30480aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe", "name": "network-vif-deleted", "tag": "2a26af6d-2714-450a-b99a-6e72dec54d7e"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:55:04.018782 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-854e91d8-46c3-4b31-bb47-465b8fa1dfc1 req-48f58643-0856-4d8f-8aa8-a50c30480aff service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:04.019282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-854e91d8-46c3-4b31-bb47-465b8fa1dfc1 req-48f58643-0856-4d8f-8aa8-a50c30480aff service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:04.019777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-854e91d8-46c3-4b31-bb47-465b8fa1dfc1 req-48f58643-0856-4d8f-8aa8-a50c30480aff service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:04.054861 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-854e91d8-46c3-4b31-bb47-465b8fa1dfc1 req-48f58643-0856-4d8f-8aa8-a50c30480aff service nova] Creating event network-vif-deleted:2a26af6d-2714-450a-b99a-6e72dec54d7e for instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe on hv-cinder-85694 Sep 11 08:55:04.082279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-854e91d8-46c3-4b31-bb47-465b8fa1dfc1 req-48f58643-0856-4d8f-8aa8-a50c30480aff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067360 Sep 11 08:55:04.083793 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 485/992] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:55:04.834386 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:04.837739 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:04.846496 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:04.846953 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:04.847474 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:04.848266 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:04.848842 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:04.849348 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:04.894709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:04.895195 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:04.895630 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:04.896077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lazy-loading 'fault' on Instance uuid 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:55:04.989063 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:05.002034 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:05.004647 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64ea6fbc6e7d42dabdf459e8de4c3621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018b87eeeda248e4a85f587c31e297f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:05.006845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-82ca941a-1049-4eaa-90a3-9859a1dd7371 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 200 len: 1370 microversion: 2.20 time: 0.180316 Sep 11 08:55:05.007883 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 508/993] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:55:04 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 11 08:55:06.053086 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:06.053800 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:06.060867 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:06.061371 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:06.062367 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:06.063098 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:06.063560 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:06.063987 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:06.078823 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] HTTP exception thrown: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Request method failure captured: Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe HTTP/1.1 Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaB_C40XblA_5JONLNSEypiACZOwRk90-JlMDAvxxPz8wSyjQX1ubyq6cAPuubBG2EObAAR_SYSnZ4Mw7s3l8yjvf1Iiu3oz6h7lVxnWUGzQHGGGt2w4RVEq7YIZotgEtVZH9_WHhQLP8mHPEUV5Kzc02ErEoDVPUzIS25A0sruBbjA Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:55:06.080551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_018b87eeeda248e4a85f587c31e297f4", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 64ea6fbc6e7d42dabdf459e8de4c3621 Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:06.083456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': '0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe'} Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:55:06.085042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:06.087577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:06.089905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Returning 404 to user: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:55:06.089905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-52dd8d5f-6d67-4844-830c-e523072d0d0d tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 404 len: 111 microversion: 2.20 time: 0.033297 Sep 11 08:55:06.089905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 486/994] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:55:06 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 08:55:06.093015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f0ccf8d1-72e9-41e2-aebc-66919a1edcdf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '.version_select at 0x7fb27ef01af0>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:06.182184 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f0ccf8d1-72e9-41e2-aebc-66919a1edcdf tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-952627283" status: 204 len: 0 microversion: 2.20 time: 0.094536 Sep 11 08:55:06.182781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 509/995] 10.222.0.44 () {60 vars in 1259 bytes} [Sun Sep 11 08:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-952627283 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 11 08:55:08.598109 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:08.600264 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:08.605505 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:08.605991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:08.606446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:08.607153 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:08.607594 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:08.608013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:08.622412 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] HTTP exception thrown: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Request method failure captured: Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: DELETE /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe HTTP/1.1 Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaB_C40XblA_5JONLNSEypiACZOwRk90-JlMDAvxxPz8wSyjQX1ubyq6cAPuubBG2EObAAR_SYSnZ4Mw7s3l8yjvf1Iiu3oz6h7lVxnWUGzQHGGGt2w4RVEq7YIZotgEtVZH9_WHhQLP8mHPEUV5Kzc02ErEoDVPUzIS25A0sruBbjA Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:55:08.623976 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_018b87eeeda248e4a85f587c31e297f4", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 64ea6fbc6e7d42dabdf459e8de4c3621 Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:08.625814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': '0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe'} Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:55:08.626939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:08.628414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:08.630346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Returning 404 to user: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:55:08.630346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-24d4f255-951b-4e50-87d9-315b92203d74 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 404 len: 111 microversion: 2.20 time: 0.031211 Sep 11 08:55:08.630346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 487/996] 10.222.0.44 () {60 vars in 1280 bytes} [Sun Sep 11 08:55:08 2022] DELETE /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 08:55:08.635120 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:08.635764 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:08.643600 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:08.644018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:08.644467 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:08.645174 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:08.645635 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:08.646065 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:08.660331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] HTTP exception thrown: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Request method failure captured: Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe HTTP/1.1 Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaB_C40XblA_5JONLNSEypiACZOwRk90-JlMDAvxxPz8wSyjQX1ubyq6cAPuubBG2EObAAR_SYSnZ4Mw7s3l8yjvf1Iiu3oz6h7lVxnWUGzQHGGGt2w4RVEq7YIZotgEtVZH9_WHhQLP8mHPEUV5Kzc02ErEoDVPUzIS25A0sruBbjA Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:55:08.661760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_018b87eeeda248e4a85f587c31e297f4", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: 64ea6fbc6e7d42dabdf459e8de4c3621 Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:08.663365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': '0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe'} Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:55:08.664107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. Sep 11 08:55:08.665339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:08.666510 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Returning 404 to user: Instance 0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:55:08.666510 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-395517dc-9e61-4c39-b5e8-677eaf9d7674 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe" status: 404 len: 111 microversion: 2.20 time: 0.032899 Sep 11 08:55:08.666510 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 510/997] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:55:08 2022] GET /compute/v2.1/servers/0f2abaf0-3a45-4ff7-b228-a9336ccd4bfe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 08:55:09.992312 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:09.993003 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:09.999370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:09.999864 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:10.001139 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:10.001139 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:10.001463 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:10.002099 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:10.018609 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] HTTP exception thrown: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Request method failure captured: Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: DELETE /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 HTTP/1.1 Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaB_C40XblA_5JONLNSEypiACZOwRk90-JlMDAvxxPz8wSyjQX1ubyq6cAPuubBG2EObAAR_SYSnZ4Mw7s3l8yjvf1Iiu3oz6h7lVxnWUGzQHGGGt2w4RVEq7YIZotgEtVZH9_WHhQLP8mHPEUV5Kzc02ErEoDVPUzIS25A0sruBbjA Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:55:10.021254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_018b87eeeda248e4a85f587c31e297f4", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: 64ea6fbc6e7d42dabdf459e8de4c3621 Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:55:10.025152 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': '223e4b7b-8a6c-4647-aa91-aae73dbeb340'} Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:55:10.026905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:55:10.029701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:10.033113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Returning 404 to user: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:55:10.033113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-74db8bc0-4457-4e83-8bbf-728ccc8facc1 tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "DELETE /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 404 len: 111 microversion: 2.20 time: 0.034235 Sep 11 08:55:10.033113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 488/998] 10.222.0.44 () {60 vars in 1280 bytes} [Sun Sep 11 08:55:09 2022] DELETE /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 11 08:55:10.033652 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:10.034242 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] [instance: 223e4b7b-8a6c-4647-aa91-aae73dbeb340] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:10.040816 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:10.041346 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:10.041781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:10.042536 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:10.043001 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:10.043424 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:10.058945 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] HTTP exception thrown: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Request method failure captured: Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 HTTP/1.1 Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaB_C40XblA_5JONLNSEypiACZOwRk90-JlMDAvxxPz8wSyjQX1ubyq6cAPuubBG2EObAAR_SYSnZ4Mw7s3l8yjvf1Iiu3oz6h7lVxnWUGzQHGGGt2w4RVEq7YIZotgEtVZH9_WHhQLP8mHPEUV5Kzc02ErEoDVPUzIS25A0sruBbjA Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Openstack-Nova-Api-Version: 2.20 Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:55:10.061225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/018b87eeeda248e4a85f587c31e297f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_018b87eeeda248e4a85f587c31e297f4", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 018b87eeeda248e4a85f587c31e297f4 Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530970946 Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: 64ea6fbc6e7d42dabdf459e8de4c3621 Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530970946-project Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:55:10.064096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': '223e4b7b-8a6c-4647-aa91-aae73dbeb340'} Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:55:10.065420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. Sep 11 08:55:10.067417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:10.069193 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] Returning 404 to user: Instance 223e4b7b-8a6c-4647-aa91-aae73dbeb340 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:55:10.069193 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-cb21ecef-cf5a-4e0b-98e6-9daec0fa421a tempest-AttachVolumeShelveTestJSON-530970946 tempest-AttachVolumeShelveTestJSON-530970946-project] 10.222.0.44 "GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340" status: 404 len: 111 microversion: 2.20 time: 0.036239 Sep 11 08:55:10.069193 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 511/999] 10.222.0.44 () {60 vars in 1277 bytes} [Sun Sep 11 08:55:10 2022] GET /compute/v2.1/servers/223e4b7b-8a6c-4647-aa91-aae73dbeb340 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 11 08:55:30.953903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-895895db-d050-48c6-a5a3-ac69059a538d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:30.954554 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-895895db-d050-48c6-a5a3-ac69059a538d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:30.957563 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:30.958263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:30.963353 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-895895db-d050-48c6-a5a3-ac69059a538d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:30.963838 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-895895db-d050-48c6-a5a3-ac69059a538d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:30.964268 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-895895db-d050-48c6-a5a3-ac69059a538d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:30.965002 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-895895db-d050-48c6-a5a3-ac69059a538d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:30.965455 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-895895db-d050-48c6-a5a3-ac69059a538d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:30.965904 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-895895db-d050-48c6-a5a3-ac69059a538d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:30.991939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-895895db-d050-48c6-a5a3-ac69059a538d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9/ips" status: 200 len: 150 microversion: 2.1 time: 0.042099 Sep 11 08:55:30.992520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 489/1000] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 08:55:30 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:55:31.008959 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bee0b579-7419-41a1-a19d-bf0006c090d7"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:55:31.013160 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:31.017417 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:31.019246 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=29 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:31.028279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:31.030392 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:31.030392 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:31.031190 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:31.031962 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:31.032751 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:31.122197 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Invalid volume: volume bee0b579-7419-41a1-a19d-bf0006c090d7 is already attached to instances: be5fbae7-a31c-412a-997f-365bb68b7ea6 Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: POST /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9/os-volume_attachments HTTP/1.1 Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 74 Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:55:31.123865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {"volumeAttachment": {"volumeId": "bee0b579-7419-41a1-a19d-bf0006c090d7"}} Sep 11 08:55:31.127005 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Invalid volume: volume bee0b579-7419-41a1-a19d-bf0006c090d7 is already attached to instances: be5fbae7-a31c-412a-997f-365bb68b7ea6 Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'server_id': 'ff049257-22d8-414c-9ad2-c5e2c33470b9', 'body': {'volumeAttachment': {'volumeId': 'bee0b579-7419-41a1-a19d-bf0006c090d7'}}} Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bee0b579-7419-41a1-a19d-bf0006c090d7 is already attached to instances: be5fbae7-a31c-412a-997f-365bb68b7ea6 Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:31.129400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bee0b579-7419-41a1-a19d-bf0006c090d7 is already attached to instances: be5fbae7-a31c-412a-997f-365bb68b7ea6 Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:31.132308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:31.135106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:31.135106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:55:31.135106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:55:31.135106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bee0b579-7419-41a1-a19d-bf0006c090d7 is already attached to instances: be5fbae7-a31c-412a-997f-365bb68b7ea6 Sep 11 08:55:31.135106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:55:31.135106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 400 to user: Invalid volume: volume bee0b579-7419-41a1-a19d-bf0006c090d7 is already attached to instances: be5fbae7-a31c-412a-997f-365bb68b7ea6 {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:55:31.135106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ee9e8067-0947-4522-b691-3e44c62f4502 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123803 Sep 11 08:55:31.135106 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 512/1001] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:55:31 2022] POST /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 08:55:31.136302 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-165123d6-88f5-42c6-99e4-45cafa66e7bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:31.136302 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-165123d6-88f5-42c6-99e4-45cafa66e7bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:31.144219 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-165123d6-88f5-42c6-99e4-45cafa66e7bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:31.144722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-165123d6-88f5-42c6-99e4-45cafa66e7bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:31.145160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-165123d6-88f5-42c6-99e4-45cafa66e7bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:31.145888 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-165123d6-88f5-42c6-99e4-45cafa66e7bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:31.146381 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-165123d6-88f5-42c6-99e4-45cafa66e7bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:31.146807 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-165123d6-88f5-42c6-99e4-45cafa66e7bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:31.174040 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-165123d6-88f5-42c6-99e4-45cafa66e7bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:55:31.502745 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-165123d6-88f5-42c6-99e4-45cafa66e7bd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 204 len: 0 microversion: 2.1 time: 0.371237 Sep 11 08:55:31.505170 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 490/1002] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:55:31 2022] DELETE /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:55:31.521785 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-4537a972-a927-441d-84e5-26f2302c3201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:31.522905 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-4537a972-a927-441d-84e5-26f2302c3201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:31.531322 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4537a972-a927-441d-84e5-26f2302c3201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:31.531819 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4537a972-a927-441d-84e5-26f2302c3201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:31.532259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4537a972-a927-441d-84e5-26f2302c3201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:31.533146 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4537a972-a927-441d-84e5-26f2302c3201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:31.533599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4537a972-a927-441d-84e5-26f2302c3201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:31.534019 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-4537a972-a927-441d-84e5-26f2302c3201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:31.681905 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-4537a972-a927-441d-84e5-26f2302c3201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:31.690275 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-4537a972-a927-441d-84e5-26f2302c3201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1682 microversion: 2.1 time: 0.173943 Sep 11 08:55:31.691520 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 513/1003] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:31 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:32.716813 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4041dbc5-21ab-42dc-983f-43c8ba4b4298 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:32.717616 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4041dbc5-21ab-42dc-983f-43c8ba4b4298 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:32.726830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4041dbc5-21ab-42dc-983f-43c8ba4b4298 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:32.727320 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4041dbc5-21ab-42dc-983f-43c8ba4b4298 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:32.727762 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4041dbc5-21ab-42dc-983f-43c8ba4b4298 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:32.728466 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4041dbc5-21ab-42dc-983f-43c8ba4b4298 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:32.728915 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4041dbc5-21ab-42dc-983f-43c8ba4b4298 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:32.729335 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4041dbc5-21ab-42dc-983f-43c8ba4b4298 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:32.890006 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4041dbc5-21ab-42dc-983f-43c8ba4b4298 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:32.898767 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4041dbc5-21ab-42dc-983f-43c8ba4b4298 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1682 microversion: 2.1 time: 0.186888 Sep 11 08:55:32.899342 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 491/1004] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:32 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:33.927375 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fe930470-23c8-4868-be0a-5000f177f503 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:33.928547 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-fe930470-23c8-4868-be0a-5000f177f503 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:33.939438 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe930470-23c8-4868-be0a-5000f177f503 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:33.945612 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe930470-23c8-4868-be0a-5000f177f503 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:33.945612 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe930470-23c8-4868-be0a-5000f177f503 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:33.945612 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe930470-23c8-4868-be0a-5000f177f503 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:33.945612 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe930470-23c8-4868-be0a-5000f177f503 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:33.946047 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fe930470-23c8-4868-be0a-5000f177f503 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:34.098400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fe930470-23c8-4868-be0a-5000f177f503 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:34.106624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-fe930470-23c8-4868-be0a-5000f177f503 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1682 microversion: 2.1 time: 0.187814 Sep 11 08:55:34.107219 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 514/1005] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:33 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:35.131865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c9e18abc-9411-4875-8353-c79329ee23c9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:35.132478 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c9e18abc-9411-4875-8353-c79329ee23c9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:35.139485 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c9e18abc-9411-4875-8353-c79329ee23c9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:35.140014 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c9e18abc-9411-4875-8353-c79329ee23c9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:35.140453 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c9e18abc-9411-4875-8353-c79329ee23c9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:35.141167 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c9e18abc-9411-4875-8353-c79329ee23c9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:35.141628 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c9e18abc-9411-4875-8353-c79329ee23c9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:35.142054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c9e18abc-9411-4875-8353-c79329ee23c9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:35.295925 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c9e18abc-9411-4875-8353-c79329ee23c9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:35.310392 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c9e18abc-9411-4875-8353-c79329ee23c9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1682 microversion: 2.1 time: 0.182896 Sep 11 08:55:35.310983 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 492/1006] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:35 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:36.334658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2062dd56-b364-483c-a48f-a9d973e4336d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:36.335500 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2062dd56-b364-483c-a48f-a9d973e4336d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:36.343091 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2062dd56-b364-483c-a48f-a9d973e4336d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:36.346183 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2062dd56-b364-483c-a48f-a9d973e4336d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:36.346183 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2062dd56-b364-483c-a48f-a9d973e4336d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:36.346183 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2062dd56-b364-483c-a48f-a9d973e4336d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:36.346183 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2062dd56-b364-483c-a48f-a9d973e4336d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:36.347203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2062dd56-b364-483c-a48f-a9d973e4336d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:36.584950 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2062dd56-b364-483c-a48f-a9d973e4336d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:36.595979 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2062dd56-b364-483c-a48f-a9d973e4336d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1682 microversion: 2.1 time: 0.265929 Sep 11 08:55:36.597011 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 515/1007] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:36 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1682 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:37.092811 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-a2b65269-b3c7-4cc8-aba5-f3c312546dfb req-c6fac0a9-2f3d-4c89-bbc9-b74c8d371636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff049257-22d8-414c-9ad2-c5e2c33470b9", "name": "network-vif-deleted", "tag": "7d6625ab-b5cb-4863-aadc-c5f604a200c0"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:55:37.110013 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-a2b65269-b3c7-4cc8-aba5-f3c312546dfb req-c6fac0a9-2f3d-4c89-bbc9-b74c8d371636 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:37.110865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-a2b65269-b3c7-4cc8-aba5-f3c312546dfb req-c6fac0a9-2f3d-4c89-bbc9-b74c8d371636 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:37.111283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-a2b65269-b3c7-4cc8-aba5-f3c312546dfb req-c6fac0a9-2f3d-4c89-bbc9-b74c8d371636 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:37.147408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-a2b65269-b3c7-4cc8-aba5-f3c312546dfb req-c6fac0a9-2f3d-4c89-bbc9-b74c8d371636 service nova] Creating event network-vif-deleted:7d6625ab-b5cb-4863-aadc-c5f604a200c0 for instance ff049257-22d8-414c-9ad2-c5e2c33470b9 on hv-cinder-85694 Sep 11 08:55:37.153198 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-a2b65269-b3c7-4cc8-aba5-f3c312546dfb req-c6fac0a9-2f3d-4c89-bbc9-b74c8d371636 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064328 Sep 11 08:55:37.155144 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 493/1008] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:55:37.629322 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:37.631051 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:37.644292 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:37.645199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:37.645876 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:37.646981 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:37.647680 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:37.648520 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:37.711622 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:37.712469 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:37.713233 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:37.714241 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lazy-loading 'fault' on Instance uuid ff049257-22d8-414c-9ad2-c5e2c33470b9 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:55:37.792135 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:37.821813 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5f8ba6b6-43f4-4fc5-b9b9-7c442a2d52cc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 200 len: 1331 microversion: 2.1 time: 0.198831 Sep 11 08:55:37.824715 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 516/1009] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:37 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 1331 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:38.869677 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:38.870442 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:38.877230 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:38.877722 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:38.878199 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:38.878922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:38.879385 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:38.879806 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:38.896641 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 HTTP/1.1 Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:55:38.898454 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:55:38.900960 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'ff049257-22d8-414c-9ad2-c5e2c33470b9'} Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:55:38.902520 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:55:38.904820 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:38.907038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:55:38.907038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b933fa4f-b45d-406d-93be-de6c0dd9d858 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 404 len: 111 microversion: 2.1 time: 0.035066 Sep 11 08:55:38.907038 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 494/1010] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:38 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:55:38.912308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c39cf3c9-c816-4cc9-ad50-4bd4384d0169 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '.version_select at 0x7fb27ed563a0>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:38.998598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c39cf3c9-c816-4cc9-ad50-4bd4384d0169 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-882350265" status: 202 len: 0 microversion: 2.1 time: 0.092916 Sep 11 08:55:38.999210 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 517/1011] 10.222.0.44 () {58 vars in 1218 bytes} [Sun Sep 11 08:55:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-882350265 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 11 08:55:40.030062 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6743b8c3-9dec-4422-aff6-c44873dba201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:40.030609 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6743b8c3-9dec-4422-aff6-c44873dba201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:40.037207 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6743b8c3-9dec-4422-aff6-c44873dba201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:40.037694 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6743b8c3-9dec-4422-aff6-c44873dba201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:40.039188 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6743b8c3-9dec-4422-aff6-c44873dba201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:40.039188 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6743b8c3-9dec-4422-aff6-c44873dba201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:40.039475 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6743b8c3-9dec-4422-aff6-c44873dba201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:40.039895 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6743b8c3-9dec-4422-aff6-c44873dba201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:40.126081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-6743b8c3-9dec-4422-aff6-c44873dba201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lazy-loading 'services' on Instance uuid be5fbae7-a31c-412a-997f-365bb68b7ea6 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:55:40.377560 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6743b8c3-9dec-4422-aff6-c44873dba201 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-volume_attachments/bee0b579-7419-41a1-a19d-bf0006c090d7" status: 202 len: 0 microversion: 2.1 time: 0.351269 Sep 11 08:55:40.384119 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 495/1012] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:55:40 2022] DELETE /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-volume_attachments/bee0b579-7419-41a1-a19d-bf0006c090d7 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:55:40.389357 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7385f6fe-7d5a-49c8-b629-e20ad7e5e469 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:40.392600 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7385f6fe-7d5a-49c8-b629-e20ad7e5e469 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:40.399882 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7385f6fe-7d5a-49c8-b629-e20ad7e5e469 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:40.400375 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7385f6fe-7d5a-49c8-b629-e20ad7e5e469 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:40.400816 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7385f6fe-7d5a-49c8-b629-e20ad7e5e469 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:40.401542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7385f6fe-7d5a-49c8-b629-e20ad7e5e469 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:40.402000 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7385f6fe-7d5a-49c8-b629-e20ad7e5e469 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:40.402463 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7385f6fe-7d5a-49c8-b629-e20ad7e5e469 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:40.442695 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7385f6fe-7d5a-49c8-b629-e20ad7e5e469 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059021 Sep 11 08:55:40.443285 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 518/1013] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:55:40 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:55:41.459228 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-093d71c1-dbd0-46e0-9da7-4fd458f74c92 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:41.461708 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-093d71c1-dbd0-46e0-9da7-4fd458f74c92 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:41.468652 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-093d71c1-dbd0-46e0-9da7-4fd458f74c92 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:41.473306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-093d71c1-dbd0-46e0-9da7-4fd458f74c92 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:41.473306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-093d71c1-dbd0-46e0-9da7-4fd458f74c92 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:41.473306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-093d71c1-dbd0-46e0-9da7-4fd458f74c92 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:41.473306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-093d71c1-dbd0-46e0-9da7-4fd458f74c92 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:41.473904 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-093d71c1-dbd0-46e0-9da7-4fd458f74c92 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:41.505799 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-093d71c1-dbd0-46e0-9da7-4fd458f74c92 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051878 Sep 11 08:55:41.507821 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 496/1014] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:55:41 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:55:42.518828 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-34893069-4a66-44fe-ada6-1f7977057848 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:42.521025 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-34893069-4a66-44fe-ada6-1f7977057848 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:42.527772 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34893069-4a66-44fe-ada6-1f7977057848 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:42.528254 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34893069-4a66-44fe-ada6-1f7977057848 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:42.528684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34893069-4a66-44fe-ada6-1f7977057848 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:42.529380 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34893069-4a66-44fe-ada6-1f7977057848 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:42.529829 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34893069-4a66-44fe-ada6-1f7977057848 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:42.530288 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-34893069-4a66-44fe-ada6-1f7977057848 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:42.579566 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-34893069-4a66-44fe-ada6-1f7977057848 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064692 Sep 11 08:55:42.580225 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 519/1015] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:55:42 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 08:55:42.652257 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-de68c3b0-fe10-4757-bf16-0b049af62432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:42.653115 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-de68c3b0-fe10-4757-bf16-0b049af62432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:42.659843 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-de68c3b0-fe10-4757-bf16-0b049af62432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:42.660359 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-de68c3b0-fe10-4757-bf16-0b049af62432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:42.660774 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-de68c3b0-fe10-4757-bf16-0b049af62432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:42.661537 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-de68c3b0-fe10-4757-bf16-0b049af62432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:42.661988 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-de68c3b0-fe10-4757-bf16-0b049af62432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:42.662457 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-de68c3b0-fe10-4757-bf16-0b049af62432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:42.690933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-de68c3b0-fe10-4757-bf16-0b049af62432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:55:43.101419 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-de68c3b0-fe10-4757-bf16-0b049af62432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 204 len: 0 microversion: 2.1 time: 0.452665 Sep 11 08:55:43.102817 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 497/1016] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:55:42 2022] DELETE /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:55:43.115177 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-58f00e3e-30c3-41c7-a0b6-a540267499ac tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:43.115177 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-58f00e3e-30c3-41c7-a0b6-a540267499ac tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:43.121308 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58f00e3e-30c3-41c7-a0b6-a540267499ac tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:43.121875 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58f00e3e-30c3-41c7-a0b6-a540267499ac tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:43.122249 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58f00e3e-30c3-41c7-a0b6-a540267499ac tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:43.122990 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58f00e3e-30c3-41c7-a0b6-a540267499ac tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:43.123442 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58f00e3e-30c3-41c7-a0b6-a540267499ac tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:43.123890 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-58f00e3e-30c3-41c7-a0b6-a540267499ac tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:43.320486 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-58f00e3e-30c3-41c7-a0b6-a540267499ac tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:43.328977 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-58f00e3e-30c3-41c7-a0b6-a540267499ac tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1679 microversion: 2.1 time: 0.220131 Sep 11 08:55:43.329579 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 520/1017] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:43 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:44.359133 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-faf51d7e-91c0-4347-b571-36c5b03ab86a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:44.360135 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-faf51d7e-91c0-4347-b571-36c5b03ab86a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:44.381572 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-faf51d7e-91c0-4347-b571-36c5b03ab86a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:44.383887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-faf51d7e-91c0-4347-b571-36c5b03ab86a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:44.385205 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-faf51d7e-91c0-4347-b571-36c5b03ab86a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:44.389359 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-faf51d7e-91c0-4347-b571-36c5b03ab86a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:44.391991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-faf51d7e-91c0-4347-b571-36c5b03ab86a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:44.392785 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-faf51d7e-91c0-4347-b571-36c5b03ab86a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:44.572212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-faf51d7e-91c0-4347-b571-36c5b03ab86a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:44.581209 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-faf51d7e-91c0-4347-b571-36c5b03ab86a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1679 microversion: 2.1 time: 0.229372 Sep 11 08:55:44.581934 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 498/1018] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:44 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:45.607318 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5cf6b5bc-3ca4-4dc7-8a4c-cf7806f168af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:45.608012 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5cf6b5bc-3ca4-4dc7-8a4c-cf7806f168af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:45.622524 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf6b5bc-3ca4-4dc7-8a4c-cf7806f168af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:45.624370 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf6b5bc-3ca4-4dc7-8a4c-cf7806f168af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:45.625333 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf6b5bc-3ca4-4dc7-8a4c-cf7806f168af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:45.627239 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf6b5bc-3ca4-4dc7-8a4c-cf7806f168af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:45.628325 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf6b5bc-3ca4-4dc7-8a4c-cf7806f168af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:45.631434 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5cf6b5bc-3ca4-4dc7-8a4c-cf7806f168af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:45.829424 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5cf6b5bc-3ca4-4dc7-8a4c-cf7806f168af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:45.853609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5cf6b5bc-3ca4-4dc7-8a4c-cf7806f168af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1612 microversion: 2.1 time: 0.250376 Sep 11 08:55:45.853895 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 521/1019] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:45 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1612 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:55:46.320555 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-80fde9f3-d122-4464-89a0-802e1b985e5a req-5c386965-5ecd-4591-bfe5-951feb23f1df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5fbae7-a31c-412a-997f-365bb68b7ea6", "name": "network-vif-deleted", "tag": "5e23f4a5-938f-4956-9719-ad21eb95651c"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:55:46.346938 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-80fde9f3-d122-4464-89a0-802e1b985e5a req-5c386965-5ecd-4591-bfe5-951feb23f1df service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:46.350039 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-80fde9f3-d122-4464-89a0-802e1b985e5a req-5c386965-5ecd-4591-bfe5-951feb23f1df service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:46.354200 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-80fde9f3-d122-4464-89a0-802e1b985e5a req-5c386965-5ecd-4591-bfe5-951feb23f1df service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:46.378082 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-80fde9f3-d122-4464-89a0-802e1b985e5a req-5c386965-5ecd-4591-bfe5-951feb23f1df service nova] Creating event network-vif-deleted:5e23f4a5-938f-4956-9719-ad21eb95651c for instance be5fbae7-a31c-412a-997f-365bb68b7ea6 on hv-cinder-85694 Sep 11 08:55:46.391966 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-80fde9f3-d122-4464-89a0-802e1b985e5a req-5c386965-5ecd-4591-bfe5-951feb23f1df service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078731 Sep 11 08:55:46.394109 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 499/1020] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:55:46.888658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:46.889498 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:46.896767 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:46.897294 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:46.897795 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:46.898573 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:46.899051 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:46.899479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:46.935788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:46.936237 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:46.936625 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:46.937213 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lazy-loading 'fault' on Instance uuid be5fbae7-a31c-412a-997f-365bb68b7ea6 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:55:46.991421 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:47.009326 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e81dc234-59ff-4fe7-8e84-623fc5e8247d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 200 len: 1330 microversion: 2.1 time: 0.123744 Sep 11 08:55:47.011438 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 522/1021] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:46 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 1330 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:48.047319 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:48.048159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:48.063382 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:48.063382 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:48.063382 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:48.063899 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:48.064627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:48.065396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:48.093274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 HTTP/1.1 Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:55:48.097160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:55:48.100429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'be5fbae7-a31c-412a-997f-365bb68b7ea6'} Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:55:48.102465 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:55:48.105632 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:55:48.108759 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:55:48.108759 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e0d0be5c-62e7-4dc2-aa37-fda11b0203af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 404 len: 111 microversion: 2.1 time: 0.060728 Sep 11 08:55:48.108759 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 500/1022] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:48 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:55:48.115619 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-53f8b84c-dd23-42a2-b001-17548ff7d22f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '.version_select at 0x7fb27ef01700>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:48.409865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-53f8b84c-dd23-42a2-b001-17548ff7d22f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-500711422" status: 202 len: 0 microversion: 2.1 time: 0.300266 Sep 11 08:55:48.410535 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 523/1023] 10.222.0.44 () {58 vars in 1218 bytes} [Sun Sep 11 08:55:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-500711422 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:55:49.756300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0ad859be-ef15-4a5d-8d33-ddbcf85af2c2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: .version_select at 0x7fb27eddae50>, body: {"keypair": {"name": "tempest-keypair-2018074376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqWgc+Q9rVu6b8BP0uQNaax9LpqQOKanpmA6GVkGf6tC7JiSSJNM8iqfL3BR8yKn4y429YXx4eWlvaJVg28mZNavb5vIhqEb9qGzzbL66/zN1BRKt04F7ZuFMN2sdY9Fw=="}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:55:49.775078 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-0ad859be-ef15-4a5d-8d33-ddbcf85af2c2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for project c0401850bdf44aaaa6c37ed752708f53. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:55:49.780239 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-0ad859be-ef15-4a5d-8d33-ddbcf85af2c2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for user c1c1de0489104713a90c59b89a284321 and project c0401850bdf44aaaa6c37ed752708f53. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:55:49.893803 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0ad859be-ef15-4a5d-8d33-ddbcf85af2c2 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143280 Sep 11 08:55:49.894497 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 501/1024] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 08:55:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:55:53.269530 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-919c844b-b067-4181-8a14-7bf83b58f06b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:53.270220 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-919c844b-b067-4181-8a14-7bf83b58f06b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:53.291409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-919c844b-b067-4181-8a14-7bf83b58f06b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:53.291917 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-919c844b-b067-4181-8a14-7bf83b58f06b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:53.292355 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-919c844b-b067-4181-8a14-7bf83b58f06b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:53.293336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-919c844b-b067-4181-8a14-7bf83b58f06b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:53.293804 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-919c844b-b067-4181-8a14-7bf83b58f06b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:53.294254 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-919c844b-b067-4181-8a14-7bf83b58f06b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:53.351803 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-79e86231-c4d2-4508-ba49-62c11d21d861 req-4825cd25-cc3c-4c19-81c3-6060bb391a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c90788-7f2f-48f0-bdcb-1b66a5c48f8b", "tag": "d9c7e947-ce3e-4ea3-8867-16f246a7639b"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:55:53.365561 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-919c844b-b067-4181-8a14-7bf83b58f06b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Going to try to terminate instance {{(pid=127646) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:55:53.376272 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-79e86231-c4d2-4508-ba49-62c11d21d861 req-4825cd25-cc3c-4c19-81c3-6060bb391a96 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:53.382502 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-79e86231-c4d2-4508-ba49-62c11d21d861 req-4825cd25-cc3c-4c19-81c3-6060bb391a96 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:53.389019 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-79e86231-c4d2-4508-ba49-62c11d21d861 req-4825cd25-cc3c-4c19-81c3-6060bb391a96 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:53.419457 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-79e86231-c4d2-4508-ba49-62c11d21d861 req-4825cd25-cc3c-4c19-81c3-6060bb391a96 service nova] Creating event network-changed:d9c7e947-ce3e-4ea3-8867-16f246a7639b for instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b on hv-cinder-85694 Sep 11 08:55:53.442803 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-79e86231-c4d2-4508-ba49-62c11d21d861 req-4825cd25-cc3c-4c19-81c3-6060bb391a96 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098146 Sep 11 08:55:53.447464 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 502/1025] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 11 08:55:53.882439 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-919c844b-b067-4181-8a14-7bf83b58f06b tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "DELETE /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 204 len: 0 microversion: 2.1 time: 0.615649 Sep 11 08:55:53.885003 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 524/1026] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:55:53 2022] DELETE /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 11 08:55:53.917539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-181b5774-9759-4bbe-b612-d4055bc02aaa tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:53.920897 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-181b5774-9759-4bbe-b612-d4055bc02aaa tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:53.943328 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-181b5774-9759-4bbe-b612-d4055bc02aaa tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:53.945323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-181b5774-9759-4bbe-b612-d4055bc02aaa tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:53.948077 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-181b5774-9759-4bbe-b612-d4055bc02aaa tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:53.951000 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-181b5774-9759-4bbe-b612-d4055bc02aaa tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:53.952367 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-181b5774-9759-4bbe-b612-d4055bc02aaa tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:53.953561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-181b5774-9759-4bbe-b612-d4055bc02aaa tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:54.205018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-621442806", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14f105a2-32ea-4014-a77a-841402520d71"}], "security_groups": [{"name": "tempest-securitygroup--1259617419"}], "key_name": "tempest-keypair-2018074376", "user_data": "}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:55:54.353172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-181b5774-9759-4bbe-b612-d4055bc02aaa tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:54.376545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-181b5774-9759-4bbe-b612-d4055bc02aaa tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.475836 Sep 11 08:55:54.386117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 503/1027] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:53 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:54.545907 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] validate_networks() for [('14f105a2-32ea-4014-a77a-841402520d71', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:55:55.438081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-02d15018-be2a-468b-abdb-5dabb04d7104 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:55.438081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-02d15018-be2a-468b-abdb-5dabb04d7104 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:55.446442 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d15018-be2a-468b-abdb-5dabb04d7104 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:55.446669 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d15018-be2a-468b-abdb-5dabb04d7104 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:55.447343 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d15018-be2a-468b-abdb-5dabb04d7104 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:55.451161 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:55:55.451161 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:55:55.451689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:55:55.451944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:55:55.452564 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:55:55.455889 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d15018-be2a-468b-abdb-5dabb04d7104 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:55.456397 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d15018-be2a-468b-abdb-5dabb04d7104 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:55.456832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-02d15018-be2a-468b-abdb-5dabb04d7104 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:55.476716 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:55.476716 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:55.476716 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:55.476716 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:55.477920 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:55.479418 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:55.540731 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for project c0401850bdf44aaaa6c37ed752708f53. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:55:55.549968 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for user c1c1de0489104713a90c59b89a284321 and project c0401850bdf44aaaa6c37ed752708f53. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:55:55.572774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:55:55.575449 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:55:55.724441 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5c1b59bf-85ab-46b9-ac52-d68f144cb196 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.531758 Sep 11 08:55:55.732866 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 525/1028] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:55:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:55:55.739240 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-734d35dd-f195-471d-ae1a-83291506c88f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:55.740116 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-734d35dd-f195-471d-ae1a-83291506c88f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:55.746581 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-02d15018-be2a-468b-abdb-5dabb04d7104 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:55.769056 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-02d15018-be2a-468b-abdb-5dabb04d7104 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.337633 Sep 11 08:55:55.771020 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 504/1029] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:55 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:55.966311 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-734d35dd-f195-471d-ae1a-83291506c88f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:55.986191 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-734d35dd-f195-471d-ae1a-83291506c88f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1241 microversion: 2.1 time: 0.251413 Sep 11 08:55:56.003112 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 526/1030] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:55 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1241 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:56.804744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a46baaa4-afe8-48d6-b7f6-8e7f066b38a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:56.805881 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a46baaa4-afe8-48d6-b7f6-8e7f066b38a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:56.820749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a46baaa4-afe8-48d6-b7f6-8e7f066b38a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:56.821841 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a46baaa4-afe8-48d6-b7f6-8e7f066b38a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:56.822992 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a46baaa4-afe8-48d6-b7f6-8e7f066b38a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:56.828683 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a46baaa4-afe8-48d6-b7f6-8e7f066b38a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:56.829654 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a46baaa4-afe8-48d6-b7f6-8e7f066b38a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:56.834248 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a46baaa4-afe8-48d6-b7f6-8e7f066b38a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:57.014636 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c7a85c2a-7969-4a30-91ee-b65341321992 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:57.015453 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c7a85c2a-7969-4a30-91ee-b65341321992 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:57.027969 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a46baaa4-afe8-48d6-b7f6-8e7f066b38a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:57.044478 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a46baaa4-afe8-48d6-b7f6-8e7f066b38a3 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1570 microversion: 2.1 time: 0.247492 Sep 11 08:55:57.075247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 505/1031] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:56 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1570 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:57.104593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c7a85c2a-7969-4a30-91ee-b65341321992 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:57.121648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c7a85c2a-7969-4a30-91ee-b65341321992 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1241 microversion: 2.1 time: 0.110804 Sep 11 08:55:57.122991 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 527/1032] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:57 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:58.076213 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-878dd6f7-2d13-465a-b4e9-9cee08306a74 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:58.077104 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-878dd6f7-2d13-465a-b4e9-9cee08306a74 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:58.087123 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-878dd6f7-2d13-465a-b4e9-9cee08306a74 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:58.088057 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-878dd6f7-2d13-465a-b4e9-9cee08306a74 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:58.088830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-878dd6f7-2d13-465a-b4e9-9cee08306a74 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:58.091022 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-878dd6f7-2d13-465a-b4e9-9cee08306a74 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:58.091022 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-878dd6f7-2d13-465a-b4e9-9cee08306a74 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:58.091022 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-878dd6f7-2d13-465a-b4e9-9cee08306a74 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:58.097636 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:55:58.153841 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-249b03cd-92ed-4396-9afe-fe7a696b7947 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:58.159674 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-249b03cd-92ed-4396-9afe-fe7a696b7947 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:58.191295 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-249b03cd-92ed-4396-9afe-fe7a696b7947 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:58.194856 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-249b03cd-92ed-4396-9afe-fe7a696b7947 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:58.196224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-249b03cd-92ed-4396-9afe-fe7a696b7947 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:58.200763 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-249b03cd-92ed-4396-9afe-fe7a696b7947 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:58.203087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-249b03cd-92ed-4396-9afe-fe7a696b7947 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:58.203768 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-249b03cd-92ed-4396-9afe-fe7a696b7947 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:58.376095 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-878dd6f7-2d13-465a-b4e9-9cee08306a74 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:58.422414 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-878dd6f7-2d13-465a-b4e9-9cee08306a74 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1503 microversion: 2.1 time: 0.350479 Sep 11 08:55:58.430350 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 506/1033] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:58 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1503 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:58.438023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-d68f3a86-2595-45de-8dfe-aeb01bbf166d req-8d3fefb2-efc7-4bea-82bf-57c4ad032df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c90788-7f2f-48f0-bdcb-1b66a5c48f8b", "name": "network-vif-deleted", "tag": "d9c7e947-ce3e-4ea3-8867-16f246a7639b"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:55:58.440810 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-249b03cd-92ed-4396-9afe-fe7a696b7947 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:58.459265 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-d68f3a86-2595-45de-8dfe-aeb01bbf166d req-8d3fefb2-efc7-4bea-82bf-57c4ad032df0 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:58.459566 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-249b03cd-92ed-4396-9afe-fe7a696b7947 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1245 microversion: 2.1 time: 0.313709 Sep 11 08:55:58.460551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-d68f3a86-2595-45de-8dfe-aeb01bbf166d req-8d3fefb2-efc7-4bea-82bf-57c4ad032df0 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:58.461399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 528/1034] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:58 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1245 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:58.463693 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-d68f3a86-2595-45de-8dfe-aeb01bbf166d req-8d3fefb2-efc7-4bea-82bf-57c4ad032df0 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:58.522693 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-d68f3a86-2595-45de-8dfe-aeb01bbf166d req-8d3fefb2-efc7-4bea-82bf-57c4ad032df0 service nova] Creating event network-vif-deleted:d9c7e947-ce3e-4ea3-8867-16f246a7639b for instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b on hv-cinder-85694 Sep 11 08:55:58.546129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-d68f3a86-2595-45de-8dfe-aeb01bbf166d req-8d3fefb2-efc7-4bea-82bf-57c4ad032df0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116448 Sep 11 08:55:58.549636 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 507/1035] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:55:59.457230 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-033a5124-d6ae-4793-9a33-77429ade32fc tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:59.459809 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-033a5124-d6ae-4793-9a33-77429ade32fc tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:59.489436 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-033a5124-d6ae-4793-9a33-77429ade32fc tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:59.490810 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-033a5124-d6ae-4793-9a33-77429ade32fc tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:59.492420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-033a5124-d6ae-4793-9a33-77429ade32fc tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:59.493976 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-033a5124-d6ae-4793-9a33-77429ade32fc tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:59.494678 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-033a5124-d6ae-4793-9a33-77429ade32fc tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:59.495471 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-033a5124-d6ae-4793-9a33-77429ade32fc tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:59.519225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1eedeece-edc6-4c57-8944-821aa276aed9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:55:59.520689 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1eedeece-edc6-4c57-8944-821aa276aed9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:55:59.541640 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1eedeece-edc6-4c57-8944-821aa276aed9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:59.542694 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1eedeece-edc6-4c57-8944-821aa276aed9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:59.543223 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1eedeece-edc6-4c57-8944-821aa276aed9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:59.544181 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1eedeece-edc6-4c57-8944-821aa276aed9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:55:59.544813 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1eedeece-edc6-4c57-8944-821aa276aed9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:55:59.545530 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1eedeece-edc6-4c57-8944-821aa276aed9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:55:59.633049 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-033a5124-d6ae-4793-9a33-77429ade32fc tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:59.683188 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-033a5124-d6ae-4793-9a33-77429ade32fc tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1384 microversion: 2.1 time: 0.237832 Sep 11 08:55:59.684764 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 529/1036] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:59 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1384 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:55:59.703906 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1eedeece-edc6-4c57-8944-821aa276aed9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:55:59.720750 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1eedeece-edc6-4c57-8944-821aa276aed9 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1293 microversion: 2.1 time: 0.216424 Sep 11 08:55:59.734356 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 508/1037] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:55:59 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1293 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:00.714823 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:00.716307 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:00.750054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-cce0314c-8b26-45d4-b255-80b89214e230 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:00.751690 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:00.753874 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-cce0314c-8b26-45d4-b255-80b89214e230 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:00.755363 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:00.759355 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=4 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:00.760741 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:00.764158 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:00.770340 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:00.772232 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:00.788584 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cce0314c-8b26-45d4-b255-80b89214e230 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:00.788584 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cce0314c-8b26-45d4-b255-80b89214e230 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:00.788584 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cce0314c-8b26-45d4-b255-80b89214e230 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:00.788584 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cce0314c-8b26-45d4-b255-80b89214e230 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:00.789227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cce0314c-8b26-45d4-b255-80b89214e230 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:00.789227 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-cce0314c-8b26-45d4-b255-80b89214e230 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:00.880822 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:00.881321 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:00.881952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:00.882701 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lazy-loading 'fault' on Instance uuid 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:56:00.886653 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:00.916400 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-cce0314c-8b26-45d4-b255-80b89214e230 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:00.930676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-cce0314c-8b26-45d4-b255-80b89214e230 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1311 microversion: 2.1 time: 0.188403 Sep 11 08:56:00.948900 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 509/1038] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:00 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:01.006905 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708d05029cef49a4a7f7cbc78fce77ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8035cc960d1f4aed981b1812e4abe6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:01.027416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e113066f-69c2-4556-8c86-59bb3a14bf55 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 200 len: 1343 microversion: 2.1 time: 0.318970 Sep 11 08:56:01.043806 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 530/1039] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:00 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 1343 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:01.960800 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-763bae26-9d02-421c-a4e8-c30b5bb4d816 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:01.960800 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-763bae26-9d02-421c-a4e8-c30b5bb4d816 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:01.968391 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-763bae26-9d02-421c-a4e8-c30b5bb4d816 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:01.968893 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-763bae26-9d02-421c-a4e8-c30b5bb4d816 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:01.969545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-763bae26-9d02-421c-a4e8-c30b5bb4d816 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:01.970678 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-763bae26-9d02-421c-a4e8-c30b5bb4d816 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:01.971365 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-763bae26-9d02-421c-a4e8-c30b5bb4d816 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:01.971804 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-763bae26-9d02-421c-a4e8-c30b5bb4d816 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:02.068872 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-763bae26-9d02-421c-a4e8-c30b5bb4d816 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:02.072661 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:02.073723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] [instance: 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:02.084274 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-763bae26-9d02-421c-a4e8-c30b5bb4d816 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1299 microversion: 2.1 time: 0.130672 Sep 11 08:56:02.085341 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 510/1040] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:01 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:56:02.086782 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:02.087465 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:02.088028 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:02.088895 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:02.089504 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:02.090055 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:02.112966 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] HTTP exception thrown: Instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b could not be found. Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Request method failure captured: Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b HTTP/1.1 Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaFWpOCznL7P_aRiKAgkOgCbcdPILGHcXU16wnoSKrMIK9u96TfCdlJ0vKtW4tFf-u5uit59FZnCWHxyqul2Q9j5az05FznFwb3qzW-_32bFCxL-bFRsFy4M2xck52pWHUd6QATFyzNi4DiWGzaJh1f7_FzsBsTGW62YlrZVUt_JN7s Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 8035cc960d1f4aed981b1812e4abe6eb Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-TestShelveInstance-1915503459 Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:56:02.115336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8035cc960d1f4aed981b1812e4abe6eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8035cc960d1f4aed981b1812e4abe6eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8035cc960d1f4aed981b1812e4abe6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8035cc960d1f4aed981b1812e4abe6eb", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-TestShelveInstance-1915503459 Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 8035cc960d1f4aed981b1812e4abe6eb Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-TestShelveInstance-1915503459 Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-TestShelveInstance-1915503459-project Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: 708d05029cef49a4a7f7cbc78fce77ab Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-TestShelveInstance-1915503459-project Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b could not be found. Sep 11 08:56:02.118588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': '63c90788-7f2f-48f0-bdcb-1b66a5c48f8b'} Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b could not be found. Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:56:02.120518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b could not be found. Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b could not be found. Sep 11 08:56:02.123400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:56:02.127415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Returning 404 to user: Instance 63c90788-7f2f-48f0-bdcb-1b66a5c48f8b could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:56:02.127415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3a559740-024c-4d98-ad3c-e4e3928a41a0 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b" status: 404 len: 111 microversion: 2.1 time: 0.057226 Sep 11 08:56:02.127415 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 531/1041] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:02 2022] GET /compute/v2.1/servers/63c90788-7f2f-48f0-bdcb-1b66a5c48f8b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:56:02.471606 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1a3b80c1-dc08-4cbe-8c30-883243cde784 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] Calling method '.version_select at 0x7fb27ec4f9d0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:02.623702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1a3b80c1-dc08-4cbe-8c30-883243cde784 tempest-TestShelveInstance-1915503459 tempest-TestShelveInstance-1915503459-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1414583063" status: 202 len: 0 microversion: 2.1 time: 0.160899 Sep 11 08:56:02.624439 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 511/1042] 10.222.0.44 () {58 vars in 1254 bytes} [Sun Sep 11 08:56:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1414583063 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:56:03.123928 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-47d0e7dc-d2cd-4ba6-9d4a-72e814c1ff05 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:03.125587 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-47d0e7dc-d2cd-4ba6-9d4a-72e814c1ff05 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:03.137394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-47d0e7dc-d2cd-4ba6-9d4a-72e814c1ff05 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:03.142138 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-47d0e7dc-d2cd-4ba6-9d4a-72e814c1ff05 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:03.142138 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-47d0e7dc-d2cd-4ba6-9d4a-72e814c1ff05 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:03.142138 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-47d0e7dc-d2cd-4ba6-9d4a-72e814c1ff05 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:03.142138 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-47d0e7dc-d2cd-4ba6-9d4a-72e814c1ff05 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:03.143130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-47d0e7dc-d2cd-4ba6-9d4a-72e814c1ff05 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:03.614363 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-47d0e7dc-d2cd-4ba6-9d4a-72e814c1ff05 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:03.625478 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-47d0e7dc-d2cd-4ba6-9d4a-72e814c1ff05 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1367 microversion: 2.1 time: 0.505746 Sep 11 08:56:03.626410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 532/1043] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:03 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1367 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:04.685738 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-aff398f7-8cf7-43c4-be9e-32a963fefcbc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:04.690995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-aff398f7-8cf7-43c4-be9e-32a963fefcbc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:04.701929 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:04.730305 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aff398f7-8cf7-43c4-be9e-32a963fefcbc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:04.738550 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aff398f7-8cf7-43c4-be9e-32a963fefcbc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:04.739666 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aff398f7-8cf7-43c4-be9e-32a963fefcbc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:04.740767 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aff398f7-8cf7-43c4-be9e-32a963fefcbc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:04.741484 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aff398f7-8cf7-43c4-be9e-32a963fefcbc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:04.742172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aff398f7-8cf7-43c4-be9e-32a963fefcbc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:04.797180 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-9053a85e-fedb-4767-90de-e6254c9bcfd1 req-ae5d47df-5af5-4450-9d8f-c4f082f91ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99d9709-d14d-4d73-bb5d-1863a957082d", "tag": "a607ef7a-9515-4094-beec-f1fd02d3f612"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:56:04.836314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:04.840367 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-9053a85e-fedb-4767-90de-e6254c9bcfd1 req-ae5d47df-5af5-4450-9d8f-c4f082f91ae8 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:04.840804 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-9053a85e-fedb-4767-90de-e6254c9bcfd1 req-ae5d47df-5af5-4450-9d8f-c4f082f91ae8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:04.840974 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-9053a85e-fedb-4767-90de-e6254c9bcfd1 req-ae5d47df-5af5-4450-9d8f-c4f082f91ae8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:04.973808 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-9053a85e-fedb-4767-90de-e6254c9bcfd1 req-ae5d47df-5af5-4450-9d8f-c4f082f91ae8 service nova] Creating event network-changed:a607ef7a-9515-4094-beec-f1fd02d3f612 for instance b99d9709-d14d-4d73-bb5d-1863a957082d on hv-cinder-85694 Sep 11 08:56:04.993306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-9053a85e-fedb-4767-90de-e6254c9bcfd1 req-ae5d47df-5af5-4450-9d8f-c4f082f91ae8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214385 Sep 11 08:56:04.996331 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 533/1044] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:56:05.448207 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-aff398f7-8cf7-43c4-be9e-32a963fefcbc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:05.462945 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-aff398f7-8cf7-43c4-be9e-32a963fefcbc tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1367 microversion: 2.1 time: 0.816436 Sep 11 08:56:05.464577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 512/1045] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:04 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1367 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:06.511432 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-59e07cee-7c5d-4c9b-bfd3-394bd854550a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:06.512223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-59e07cee-7c5d-4c9b-bfd3-394bd854550a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:06.521239 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:06.528676 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-59e07cee-7c5d-4c9b-bfd3-394bd854550a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:06.529669 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-59e07cee-7c5d-4c9b-bfd3-394bd854550a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:06.530327 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-59e07cee-7c5d-4c9b-bfd3-394bd854550a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:06.531271 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-59e07cee-7c5d-4c9b-bfd3-394bd854550a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:06.531923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-59e07cee-7c5d-4c9b-bfd3-394bd854550a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:06.532563 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-59e07cee-7c5d-4c9b-bfd3-394bd854550a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:07.056203 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-59e07cee-7c5d-4c9b-bfd3-394bd854550a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:07.079018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-59e07cee-7c5d-4c9b-bfd3-394bd854550a tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1367 microversion: 2.1 time: 0.578247 Sep 11 08:56:07.080597 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 534/1046] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:06 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1367 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:08.125331 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1e1ee666-9112-4568-9a67-878cf715757b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:08.126069 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1e1ee666-9112-4568-9a67-878cf715757b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:08.134409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e1ee666-9112-4568-9a67-878cf715757b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:08.134914 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e1ee666-9112-4568-9a67-878cf715757b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:08.135362 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e1ee666-9112-4568-9a67-878cf715757b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:08.136088 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e1ee666-9112-4568-9a67-878cf715757b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:08.136613 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e1ee666-9112-4568-9a67-878cf715757b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:08.137045 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1e1ee666-9112-4568-9a67-878cf715757b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:08.534198 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1e1ee666-9112-4568-9a67-878cf715757b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:08.550360 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1e1ee666-9112-4568-9a67-878cf715757b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1367 microversion: 2.1 time: 0.428902 Sep 11 08:56:08.551634 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 513/1047] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:08 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:09.577743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-618ffac0-21ee-4efa-9de1-b476d4a441b4 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:09.582365 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-618ffac0-21ee-4efa-9de1-b476d4a441b4 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:09.590956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=10 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:09.598057 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-618ffac0-21ee-4efa-9de1-b476d4a441b4 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:09.599160 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-618ffac0-21ee-4efa-9de1-b476d4a441b4 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:09.604087 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-618ffac0-21ee-4efa-9de1-b476d4a441b4 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:09.605604 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-618ffac0-21ee-4efa-9de1-b476d4a441b4 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:09.606852 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-618ffac0-21ee-4efa-9de1-b476d4a441b4 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:09.607683 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-618ffac0-21ee-4efa-9de1-b476d4a441b4 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:09.925397 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-618ffac0-21ee-4efa-9de1-b476d4a441b4 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:09.934995 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-618ffac0-21ee-4efa-9de1-b476d4a441b4 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1367 microversion: 2.1 time: 0.362397 Sep 11 08:56:09.935595 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 535/1048] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:09 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:56:10.655643 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-39e4944c-4c95-4732-b6df-09aca5781ef0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Action: 'create', calling method: .version_select at 0x7fb27ed880d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-425546129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrwTtiry7yghKS6bdTQDzgyNVi8cPR/ikWh0feYhpJiMgt4F4oWLlIUQrlojfHazoqOlGBcEDvAnb2F8ERy2JiLog+VLO2oQeDBtcFip1HFsOPX060f2hBsMKuofHus6A=="}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:56:10.692910 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-39e4944c-4c95-4732-b6df-09aca5781ef0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Getting quotas for project 6d5504106ccb4549b09f29d7104d9b0a. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:56:10.700787 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-39e4944c-4c95-4732-b6df-09aca5781ef0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Getting quotas for user ed50f5d8261d44b487390de092ef9136 and project 6d5504106ccb4549b09f29d7104d9b0a. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:56:10.805614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-39e4944c-4c95-4732-b6df-09aca5781ef0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.588607 Sep 11 08:56:10.809523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 514/1049] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 08:56:10 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:56:10.962141 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c901dd53-58b2-4659-a309-1cb0654f6f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:10.963810 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c901dd53-58b2-4659-a309-1cb0654f6f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:10.975643 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c901dd53-58b2-4659-a309-1cb0654f6f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:10.976721 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c901dd53-58b2-4659-a309-1cb0654f6f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:10.977698 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c901dd53-58b2-4659-a309-1cb0654f6f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:10.978721 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c901dd53-58b2-4659-a309-1cb0654f6f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:10.979355 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c901dd53-58b2-4659-a309-1cb0654f6f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:10.980739 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c901dd53-58b2-4659-a309-1cb0654f6f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:11.270775 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c901dd53-58b2-4659-a309-1cb0654f6f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:11.278393 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c901dd53-58b2-4659-a309-1cb0654f6f14 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1367 microversion: 2.1 time: 0.322606 Sep 11 08:56:11.279976 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 536/1050] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:10 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:12.207111 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-99222378-6bc4-42e3-a96b-0ded20a3b5c0 req-2ba62cc7-33d8-421f-bc26-b045f8b4cb7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99d9709-d14d-4d73-bb5d-1863a957082d", "name": "network-vif-plugged", "status": "completed", "tag": "a607ef7a-9515-4094-beec-f1fd02d3f612"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:56:12.219849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-99222378-6bc4-42e3-a96b-0ded20a3b5c0 req-2ba62cc7-33d8-421f-bc26-b045f8b4cb7a service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:12.220851 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-99222378-6bc4-42e3-a96b-0ded20a3b5c0 req-2ba62cc7-33d8-421f-bc26-b045f8b4cb7a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:12.223559 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-99222378-6bc4-42e3-a96b-0ded20a3b5c0 req-2ba62cc7-33d8-421f-bc26-b045f8b4cb7a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:12.233772 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-99222378-6bc4-42e3-a96b-0ded20a3b5c0 req-2ba62cc7-33d8-421f-bc26-b045f8b4cb7a service nova] Creating event network-vif-plugged:a607ef7a-9515-4094-beec-f1fd02d3f612 for instance b99d9709-d14d-4d73-bb5d-1863a957082d on hv-cinder-85694 Sep 11 08:56:12.240887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-99222378-6bc4-42e3-a96b-0ded20a3b5c0 req-2ba62cc7-33d8-421f-bc26-b045f8b4cb7a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047064 Sep 11 08:56:12.241499 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 515/1051] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:56:12.309198 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9e6b971d-dbbb-42b9-9f31-dd391185cf5b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:12.311591 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9e6b971d-dbbb-42b9-9f31-dd391185cf5b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:12.332553 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9e6b971d-dbbb-42b9-9f31-dd391185cf5b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:12.340018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9e6b971d-dbbb-42b9-9f31-dd391185cf5b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:12.340018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9e6b971d-dbbb-42b9-9f31-dd391185cf5b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:12.340018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9e6b971d-dbbb-42b9-9f31-dd391185cf5b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:12.342887 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9e6b971d-dbbb-42b9-9f31-dd391185cf5b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:12.346990 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9e6b971d-dbbb-42b9-9f31-dd391185cf5b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:12.659813 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9e6b971d-dbbb-42b9-9f31-dd391185cf5b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:12.673114 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9e6b971d-dbbb-42b9-9f31-dd391185cf5b tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1367 microversion: 2.1 time: 0.370873 Sep 11 08:56:12.674943 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 537/1052] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:12 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:13.701966 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b3fd355c-3bbe-4434-9e79-c0e12eec811c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:13.703782 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b3fd355c-3bbe-4434-9e79-c0e12eec811c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:13.715121 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b3fd355c-3bbe-4434-9e79-c0e12eec811c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:13.715869 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b3fd355c-3bbe-4434-9e79-c0e12eec811c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:13.716422 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b3fd355c-3bbe-4434-9e79-c0e12eec811c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:13.721835 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b3fd355c-3bbe-4434-9e79-c0e12eec811c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:13.721835 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b3fd355c-3bbe-4434-9e79-c0e12eec811c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:13.721835 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b3fd355c-3bbe-4434-9e79-c0e12eec811c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:14.221574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b3fd355c-3bbe-4434-9e79-c0e12eec811c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:14.240462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b3fd355c-3bbe-4434-9e79-c0e12eec811c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1367 microversion: 2.1 time: 0.545009 Sep 11 08:56:14.242251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 516/1053] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:13 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1367 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:15.275740 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-896260c7-c818-486f-a051-7c56129a410f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:15.276384 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-896260c7-c818-486f-a051-7c56129a410f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:15.289162 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-896260c7-c818-486f-a051-7c56129a410f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:15.289362 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-896260c7-c818-486f-a051-7c56129a410f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:15.289833 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-896260c7-c818-486f-a051-7c56129a410f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:15.294352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-896260c7-c818-486f-a051-7c56129a410f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:15.295049 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-896260c7-c818-486f-a051-7c56129a410f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:15.295700 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-896260c7-c818-486f-a051-7c56129a410f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:15.522964 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-896260c7-c818-486f-a051-7c56129a410f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:15.536193 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-896260c7-c818-486f-a051-7c56129a410f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1558 microversion: 2.1 time: 0.268821 Sep 11 08:56:15.538980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 538/1054] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:15 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1558 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:15.557939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-311f7479-521e-4377-bf50-ee569306a599 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:15.559715 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-311f7479-521e-4377-bf50-ee569306a599 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:15.569047 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311f7479-521e-4377-bf50-ee569306a599 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:15.569552 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311f7479-521e-4377-bf50-ee569306a599 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:15.572313 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311f7479-521e-4377-bf50-ee569306a599 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:15.572313 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311f7479-521e-4377-bf50-ee569306a599 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:15.572313 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311f7479-521e-4377-bf50-ee569306a599 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:15.572313 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-311f7479-521e-4377-bf50-ee569306a599 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:15.676753 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-311f7479-521e-4377-bf50-ee569306a599 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124241 Sep 11 08:56:15.677551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 517/1055] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 08:56:15 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:56:17.300968 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-8cffb805-2fbf-431d-b11d-00b1f2ffeb11 req-09327742-50ca-46d2-9a62-2e0f530372ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99d9709-d14d-4d73-bb5d-1863a957082d", "tag": "a607ef7a-9515-4094-beec-f1fd02d3f612"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:56:17.315709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-8cffb805-2fbf-431d-b11d-00b1f2ffeb11 req-09327742-50ca-46d2-9a62-2e0f530372ce service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:17.330646 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-8cffb805-2fbf-431d-b11d-00b1f2ffeb11 req-09327742-50ca-46d2-9a62-2e0f530372ce service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:17.330646 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-8cffb805-2fbf-431d-b11d-00b1f2ffeb11 req-09327742-50ca-46d2-9a62-2e0f530372ce service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:17.344229 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-8cffb805-2fbf-431d-b11d-00b1f2ffeb11 req-09327742-50ca-46d2-9a62-2e0f530372ce service nova] Creating event network-changed:a607ef7a-9515-4094-beec-f1fd02d3f612 for instance b99d9709-d14d-4d73-bb5d-1863a957082d on hv-cinder-85694 Sep 11 08:56:17.350310 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-8cffb805-2fbf-431d-b11d-00b1f2ffeb11 req-09327742-50ca-46d2-9a62-2e0f530372ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054240 Sep 11 08:56:17.351444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 539/1056] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:56:34.300593 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=4 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:34.301462 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:34.302117 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=48 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:34.306183 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1104187293", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-425546129", "security_groups": [{"name": "tempest-secgroup-smoke-1731546175"}], "block_device_mapping_v2": [{"uuid": "1c8149ad-7ed1-4f99-811f-ef522e75949b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e66bcb0e-f46e-44d7-8b38-5be5802adf36"}]}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:56:34.423526 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.network.neutron [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] validate_networks() for [('e66bcb0e-f46e-44d7-8b38-5be5802adf36', None, None, None, None, None)] {{(pid=127647) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:56:34.854286 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Flavor limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:56:34.854767 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Image limits 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:56:34.855326 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Flavor pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:56:34.855766 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Image pref 0:0:0 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:56:34.856207 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.virt.hardware [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:56:34.868170 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:34.868655 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:34.869123 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:34.869856 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:34.870349 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:34.870778 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:34.888987 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Getting quotas for project 6d5504106ccb4549b09f29d7104d9b0a. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:56:34.893625 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Getting quotas for user ed50f5d8261d44b487390de092ef9136 and project 6d5504106ccb4549b09f29d7104d9b0a. Resources: {'cores', 'instances', 'ram'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:56:34.953108 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Going to run 1 instances... {{(pid=127647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:56:34.955601 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c8149ad-7ed1-4f99-811f-ef522e75949b',volume_size=None,volume_type=None)] {{(pid=127647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:56:35.506709 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3e148bdc-e562-4762-958b-40d9b5c152f6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.207268 Sep 11 08:56:35.507541 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 518/1057] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:56:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:56:35.517069 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=13 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:35.517829 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=44 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:35.521919 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-8d862708-9276-4712-9086-e5db4a1c0988 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:35.522650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-8d862708-9276-4712-9086-e5db4a1c0988 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:35.587144 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-8d862708-9276-4712-9086-e5db4a1c0988 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:35.600055 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-8d862708-9276-4712-9086-e5db4a1c0988 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1094 microversion: 2.1 time: 0.084691 Sep 11 08:56:35.600924 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 540/1058] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:35 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:36.624390 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bf01bee6-138d-49f5-b52d-3b0ac705b3d6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:36.624997 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bf01bee6-138d-49f5-b52d-3b0ac705b3d6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:36.680030 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bf01bee6-138d-49f5-b52d-3b0ac705b3d6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:36.687121 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bf01bee6-138d-49f5-b52d-3b0ac705b3d6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1094 microversion: 2.1 time: 0.067155 Sep 11 08:56:36.689857 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 519/1059] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:36 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:37.712015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-66ab737f-dbe1-46ac-9def-a7261bbd9e1e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:37.712595 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-66ab737f-dbe1-46ac-9def-a7261bbd9e1e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:37.721155 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66ab737f-dbe1-46ac-9def-a7261bbd9e1e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:37.721651 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66ab737f-dbe1-46ac-9def-a7261bbd9e1e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:37.722159 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66ab737f-dbe1-46ac-9def-a7261bbd9e1e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:37.722860 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66ab737f-dbe1-46ac-9def-a7261bbd9e1e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:37.723317 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66ab737f-dbe1-46ac-9def-a7261bbd9e1e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:37.723738 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-66ab737f-dbe1-46ac-9def-a7261bbd9e1e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:37.792306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-66ab737f-dbe1-46ac-9def-a7261bbd9e1e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:37.802588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-66ab737f-dbe1-46ac-9def-a7261bbd9e1e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1192 microversion: 2.1 time: 0.094676 Sep 11 08:56:37.803445 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 541/1060] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:37 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:38.827120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-fe4594ee-34ee-4435-a301-0f9e0dfd6837 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:38.828266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-fe4594ee-34ee-4435-a301-0f9e0dfd6837 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:38.838639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe4594ee-34ee-4435-a301-0f9e0dfd6837 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:38.838639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe4594ee-34ee-4435-a301-0f9e0dfd6837 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:38.839141 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe4594ee-34ee-4435-a301-0f9e0dfd6837 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:38.839871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe4594ee-34ee-4435-a301-0f9e0dfd6837 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:38.840784 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe4594ee-34ee-4435-a301-0f9e0dfd6837 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:38.840784 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fe4594ee-34ee-4435-a301-0f9e0dfd6837 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:39.091772 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-fe4594ee-34ee-4435-a301-0f9e0dfd6837 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:39.100993 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-fe4594ee-34ee-4435-a301-0f9e0dfd6837 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1210 microversion: 2.1 time: 0.277971 Sep 11 08:56:39.101887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 520/1061] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:38 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1210 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:40.128923 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-39c14d79-4829-461f-a40d-9f07a2771fb2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:40.130107 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-39c14d79-4829-461f-a40d-9f07a2771fb2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:40.142686 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-39c14d79-4829-461f-a40d-9f07a2771fb2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:40.143583 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-39c14d79-4829-461f-a40d-9f07a2771fb2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:40.144391 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-39c14d79-4829-461f-a40d-9f07a2771fb2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:40.145710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-39c14d79-4829-461f-a40d-9f07a2771fb2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:40.146606 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-39c14d79-4829-461f-a40d-9f07a2771fb2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:40.147410 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-39c14d79-4829-461f-a40d-9f07a2771fb2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:40.547215 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-39c14d79-4829-461f-a40d-9f07a2771fb2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:40.558098 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-39c14d79-4829-461f-a40d-9f07a2771fb2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1278 microversion: 2.1 time: 0.436019 Sep 11 08:56:40.559675 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 542/1062] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:40 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1278 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:40.723218 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-de084855-879d-421e-aab4-8abcdad4265b req-097125fd-52b7-43b7-bc56-13629050e83f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d102028f-9e13-426e-ae8e-dfc13f6ea147", "tag": "3f4adc04-6422-427d-b39e-78573123bcc9"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:56:40.734178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-de084855-879d-421e-aab4-8abcdad4265b req-097125fd-52b7-43b7-bc56-13629050e83f service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:40.734773 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-de084855-879d-421e-aab4-8abcdad4265b req-097125fd-52b7-43b7-bc56-13629050e83f service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:40.735215 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-de084855-879d-421e-aab4-8abcdad4265b req-097125fd-52b7-43b7-bc56-13629050e83f service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:40.748887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-de084855-879d-421e-aab4-8abcdad4265b req-097125fd-52b7-43b7-bc56-13629050e83f service nova] Creating event network-changed:3f4adc04-6422-427d-b39e-78573123bcc9 for instance d102028f-9e13-426e-ae8e-dfc13f6ea147 on hv-cinder-85694 Sep 11 08:56:40.754991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-de084855-879d-421e-aab4-8abcdad4265b req-097125fd-52b7-43b7-bc56-13629050e83f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035396 Sep 11 08:56:40.755527 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 521/1063] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:56:41.585133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-770ebd10-b49c-4518-8095-51030b62096c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:41.585808 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-770ebd10-b49c-4518-8095-51030b62096c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:41.592352 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-770ebd10-b49c-4518-8095-51030b62096c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:41.592906 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-770ebd10-b49c-4518-8095-51030b62096c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:41.593336 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-770ebd10-b49c-4518-8095-51030b62096c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:41.594036 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-770ebd10-b49c-4518-8095-51030b62096c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:41.594530 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-770ebd10-b49c-4518-8095-51030b62096c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:41.595119 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-770ebd10-b49c-4518-8095-51030b62096c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:42.008773 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-770ebd10-b49c-4518-8095-51030b62096c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:42.017370 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-770ebd10-b49c-4518-8095-51030b62096c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.435558 Sep 11 08:56:42.017964 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 543/1064] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:41 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:43.041567 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c0442c85-87ac-474c-bbf7-c995b46b4c8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:43.042325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c0442c85-87ac-474c-bbf7-c995b46b4c8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:43.049014 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0442c85-87ac-474c-bbf7-c995b46b4c8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:43.049497 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0442c85-87ac-474c-bbf7-c995b46b4c8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:43.049935 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0442c85-87ac-474c-bbf7-c995b46b4c8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:43.050714 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0442c85-87ac-474c-bbf7-c995b46b4c8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:43.051146 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0442c85-87ac-474c-bbf7-c995b46b4c8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:43.051574 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c0442c85-87ac-474c-bbf7-c995b46b4c8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:43.188363 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-c0442c85-87ac-474c-bbf7-c995b46b4c8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:43.197223 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c0442c85-87ac-474c-bbf7-c995b46b4c8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.160401 Sep 11 08:56:43.197815 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 522/1065] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:43 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:44.224507 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2778a3ce-11d3-47f7-b141-8749a6157b50 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:44.225166 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2778a3ce-11d3-47f7-b141-8749a6157b50 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:44.231797 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2778a3ce-11d3-47f7-b141-8749a6157b50 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:44.232384 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2778a3ce-11d3-47f7-b141-8749a6157b50 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:44.232935 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2778a3ce-11d3-47f7-b141-8749a6157b50 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:44.233899 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2778a3ce-11d3-47f7-b141-8749a6157b50 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:44.234387 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2778a3ce-11d3-47f7-b141-8749a6157b50 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:44.234812 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2778a3ce-11d3-47f7-b141-8749a6157b50 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:44.377593 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2778a3ce-11d3-47f7-b141-8749a6157b50 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:44.385425 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2778a3ce-11d3-47f7-b141-8749a6157b50 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.165689 Sep 11 08:56:44.386002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 544/1066] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:44 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:45.409126 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5dfe4f4f-6cc2-4e19-935e-84c595b43b8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:45.409737 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5dfe4f4f-6cc2-4e19-935e-84c595b43b8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:45.412171 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:45.417112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5dfe4f4f-6cc2-4e19-935e-84c595b43b8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:45.417612 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5dfe4f4f-6cc2-4e19-935e-84c595b43b8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:45.418047 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5dfe4f4f-6cc2-4e19-935e-84c595b43b8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:45.418788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5dfe4f4f-6cc2-4e19-935e-84c595b43b8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:45.419244 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5dfe4f4f-6cc2-4e19-935e-84c595b43b8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:45.419669 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5dfe4f4f-6cc2-4e19-935e-84c595b43b8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:45.558247 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5dfe4f4f-6cc2-4e19-935e-84c595b43b8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:45.571627 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5dfe4f4f-6cc2-4e19-935e-84c595b43b8b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.166851 Sep 11 08:56:45.572224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 523/1067] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:45 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:46.594300 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0b6e8c5d-d8cc-4ee1-b6db-3799c6e478c8 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:46.594953 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0b6e8c5d-d8cc-4ee1-b6db-3799c6e478c8 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:46.597302 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:46.602063 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6e8c5d-d8cc-4ee1-b6db-3799c6e478c8 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:46.605462 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6e8c5d-d8cc-4ee1-b6db-3799c6e478c8 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:46.605462 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6e8c5d-d8cc-4ee1-b6db-3799c6e478c8 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:46.605462 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6e8c5d-d8cc-4ee1-b6db-3799c6e478c8 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:46.605462 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6e8c5d-d8cc-4ee1-b6db-3799c6e478c8 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:46.605853 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6e8c5d-d8cc-4ee1-b6db-3799c6e478c8 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:46.750717 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0b6e8c5d-d8cc-4ee1-b6db-3799c6e478c8 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:46.758409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0b6e8c5d-d8cc-4ee1-b6db-3799c6e478c8 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.167874 Sep 11 08:56:46.758941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 545/1068] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:46 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:47.780548 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5bbb11b7-4b4d-407a-b405-95c12a35e07f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:47.781264 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5bbb11b7-4b4d-407a-b405-95c12a35e07f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:47.784201 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=8 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:56:47.788925 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5bbb11b7-4b4d-407a-b405-95c12a35e07f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:47.789404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5bbb11b7-4b4d-407a-b405-95c12a35e07f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:47.789832 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5bbb11b7-4b4d-407a-b405-95c12a35e07f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:47.790549 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5bbb11b7-4b4d-407a-b405-95c12a35e07f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:47.791000 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5bbb11b7-4b4d-407a-b405-95c12a35e07f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:47.791418 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5bbb11b7-4b4d-407a-b405-95c12a35e07f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:47.926430 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5bbb11b7-4b4d-407a-b405-95c12a35e07f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:47.934130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5bbb11b7-4b4d-407a-b405-95c12a35e07f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.157614 Sep 11 08:56:47.934730 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 524/1069] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:47 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:48.957461 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-eeeb18db-f4f6-4e97-b338-24b671339ab2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:48.958099 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-eeeb18db-f4f6-4e97-b338-24b671339ab2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:48.964071 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eeeb18db-f4f6-4e97-b338-24b671339ab2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:48.964555 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eeeb18db-f4f6-4e97-b338-24b671339ab2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:48.964991 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eeeb18db-f4f6-4e97-b338-24b671339ab2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:48.965678 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eeeb18db-f4f6-4e97-b338-24b671339ab2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:48.966157 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eeeb18db-f4f6-4e97-b338-24b671339ab2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:48.966576 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eeeb18db-f4f6-4e97-b338-24b671339ab2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:49.098314 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-eeeb18db-f4f6-4e97-b338-24b671339ab2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:49.108685 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-eeeb18db-f4f6-4e97-b338-24b671339ab2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.155610 Sep 11 08:56:49.109282 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 546/1070] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:48 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:50.132933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-99742405-4ed0-429e-82f9-b49521a4fb49 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:50.133739 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-99742405-4ed0-429e-82f9-b49521a4fb49 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:50.140516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99742405-4ed0-429e-82f9-b49521a4fb49 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:50.141090 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99742405-4ed0-429e-82f9-b49521a4fb49 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:50.141543 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99742405-4ed0-429e-82f9-b49521a4fb49 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:50.143037 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99742405-4ed0-429e-82f9-b49521a4fb49 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:50.143037 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99742405-4ed0-429e-82f9-b49521a4fb49 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:50.143295 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-99742405-4ed0-429e-82f9-b49521a4fb49 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:50.280590 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-99742405-4ed0-429e-82f9-b49521a4fb49 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:50.288280 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-99742405-4ed0-429e-82f9-b49521a4fb49 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.159637 Sep 11 08:56:50.288843 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 525/1071] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:50 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:51.311026 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-eb34c58a-e968-42ef-b0ef-0d5812c25873 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:51.311621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-eb34c58a-e968-42ef-b0ef-0d5812c25873 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:51.317917 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb34c58a-e968-42ef-b0ef-0d5812c25873 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:51.318426 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb34c58a-e968-42ef-b0ef-0d5812c25873 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:51.318865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb34c58a-e968-42ef-b0ef-0d5812c25873 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:51.319542 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb34c58a-e968-42ef-b0ef-0d5812c25873 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:51.319987 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb34c58a-e968-42ef-b0ef-0d5812c25873 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:51.320412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb34c58a-e968-42ef-b0ef-0d5812c25873 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:51.455854 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-eb34c58a-e968-42ef-b0ef-0d5812c25873 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:51.463669 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-eb34c58a-e968-42ef-b0ef-0d5812c25873 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.156518 Sep 11 08:56:51.464239 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 547/1072] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:51 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:52.486809 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a930438b-ecd6-4f3e-8286-06e9b61fcaa6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:52.487525 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a930438b-ecd6-4f3e-8286-06e9b61fcaa6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:52.494164 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a930438b-ecd6-4f3e-8286-06e9b61fcaa6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:52.494660 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a930438b-ecd6-4f3e-8286-06e9b61fcaa6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:52.495094 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a930438b-ecd6-4f3e-8286-06e9b61fcaa6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:52.495800 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a930438b-ecd6-4f3e-8286-06e9b61fcaa6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:52.496439 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a930438b-ecd6-4f3e-8286-06e9b61fcaa6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:52.496876 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a930438b-ecd6-4f3e-8286-06e9b61fcaa6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:52.640723 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a930438b-ecd6-4f3e-8286-06e9b61fcaa6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:52.649109 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a930438b-ecd6-4f3e-8286-06e9b61fcaa6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.166700 Sep 11 08:56:52.650474 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 526/1073] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:52 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:53.672120 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c239e4d5-e3fc-41b7-a277-286e5359beaf tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:53.672734 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c239e4d5-e3fc-41b7-a277-286e5359beaf tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:53.679199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c239e4d5-e3fc-41b7-a277-286e5359beaf tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:53.679710 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c239e4d5-e3fc-41b7-a277-286e5359beaf tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:53.680144 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c239e4d5-e3fc-41b7-a277-286e5359beaf tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:53.680834 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c239e4d5-e3fc-41b7-a277-286e5359beaf tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:53.681285 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c239e4d5-e3fc-41b7-a277-286e5359beaf tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:53.681699 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c239e4d5-e3fc-41b7-a277-286e5359beaf tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:53.833317 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c239e4d5-e3fc-41b7-a277-286e5359beaf tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:53.843351 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c239e4d5-e3fc-41b7-a277-286e5359beaf tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.174064 Sep 11 08:56:53.855094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 548/1074] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:53 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:54.867310 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-24db2eaa-f6fe-41dd-a2b0-2b1e5aaa9a67 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:54.868087 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-24db2eaa-f6fe-41dd-a2b0-2b1e5aaa9a67 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:54.874283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24db2eaa-f6fe-41dd-a2b0-2b1e5aaa9a67 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:54.874802 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24db2eaa-f6fe-41dd-a2b0-2b1e5aaa9a67 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:54.875336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24db2eaa-f6fe-41dd-a2b0-2b1e5aaa9a67 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:54.876240 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24db2eaa-f6fe-41dd-a2b0-2b1e5aaa9a67 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:54.876761 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24db2eaa-f6fe-41dd-a2b0-2b1e5aaa9a67 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:54.877243 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-24db2eaa-f6fe-41dd-a2b0-2b1e5aaa9a67 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:55.064309 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-24db2eaa-f6fe-41dd-a2b0-2b1e5aaa9a67 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:55.071808 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-24db2eaa-f6fe-41dd-a2b0-2b1e5aaa9a67 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.208464 Sep 11 08:56:55.072381 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 527/1075] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:54 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:55.993888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-0bbdfe73-fc42-4f81-b422-bbdb284ece89 req-444f2bec-362b-4d29-bafa-a71f5c3d7ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d102028f-9e13-426e-ae8e-dfc13f6ea147", "name": "network-vif-plugged", "status": "completed", "tag": "3f4adc04-6422-427d-b39e-78573123bcc9"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:56:56.005747 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-0bbdfe73-fc42-4f81-b422-bbdb284ece89 req-444f2bec-362b-4d29-bafa-a71f5c3d7ff2 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:56.006265 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-0bbdfe73-fc42-4f81-b422-bbdb284ece89 req-444f2bec-362b-4d29-bafa-a71f5c3d7ff2 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:56.006707 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-0bbdfe73-fc42-4f81-b422-bbdb284ece89 req-444f2bec-362b-4d29-bafa-a71f5c3d7ff2 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:56.018562 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-0bbdfe73-fc42-4f81-b422-bbdb284ece89 req-444f2bec-362b-4d29-bafa-a71f5c3d7ff2 service nova] Creating event network-vif-plugged:3f4adc04-6422-427d-b39e-78573123bcc9 for instance d102028f-9e13-426e-ae8e-dfc13f6ea147 on hv-cinder-85694 Sep 11 08:56:56.024175 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-0bbdfe73-fc42-4f81-b422-bbdb284ece89 req-444f2bec-362b-4d29-bafa-a71f5c3d7ff2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034013 Sep 11 08:56:56.024794 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 549/1076] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:56:56.095306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3ffed2a7-62a3-4919-aad6-f2e8cbe4c25d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:56.096188 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3ffed2a7-62a3-4919-aad6-f2e8cbe4c25d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:56.103178 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3ffed2a7-62a3-4919-aad6-f2e8cbe4c25d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:56.103764 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3ffed2a7-62a3-4919-aad6-f2e8cbe4c25d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:56.104260 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3ffed2a7-62a3-4919-aad6-f2e8cbe4c25d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:56.105201 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3ffed2a7-62a3-4919-aad6-f2e8cbe4c25d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:56.105726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3ffed2a7-62a3-4919-aad6-f2e8cbe4c25d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:56.106241 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3ffed2a7-62a3-4919-aad6-f2e8cbe4c25d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:56.287753 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3ffed2a7-62a3-4919-aad6-f2e8cbe4c25d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:56.296539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3ffed2a7-62a3-4919-aad6-f2e8cbe4c25d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.205600 Sep 11 08:56:56.300019 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 528/1077] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:56 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:57.319895 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-f10bb8bb-9f10-4179-b10a-a085fe67e313 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:57.320855 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-f10bb8bb-9f10-4179-b10a-a085fe67e313 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:57.327174 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f10bb8bb-9f10-4179-b10a-a085fe67e313 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:57.327867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f10bb8bb-9f10-4179-b10a-a085fe67e313 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:57.328306 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f10bb8bb-9f10-4179-b10a-a085fe67e313 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:57.329006 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f10bb8bb-9f10-4179-b10a-a085fe67e313 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:57.329459 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f10bb8bb-9f10-4179-b10a-a085fe67e313 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:57.329883 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-f10bb8bb-9f10-4179-b10a-a085fe67e313 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:57.467547 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-f10bb8bb-9f10-4179-b10a-a085fe67e313 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:57.476836 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-f10bb8bb-9f10-4179-b10a-a085fe67e313 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1266 microversion: 2.1 time: 0.161594 Sep 11 08:56:57.477512 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 550/1078] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:57 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:58.500024 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e2fb17a6-18df-4eae-87aa-0168c9993503 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:58.500639 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e2fb17a6-18df-4eae-87aa-0168c9993503 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:58.507337 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2fb17a6-18df-4eae-87aa-0168c9993503 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:58.507830 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2fb17a6-18df-4eae-87aa-0168c9993503 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:58.508269 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2fb17a6-18df-4eae-87aa-0168c9993503 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:58.509150 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2fb17a6-18df-4eae-87aa-0168c9993503 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:58.509611 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2fb17a6-18df-4eae-87aa-0168c9993503 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:58.510077 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e2fb17a6-18df-4eae-87aa-0168c9993503 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:58.649392 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e2fb17a6-18df-4eae-87aa-0168c9993503 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:58.657292 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e2fb17a6-18df-4eae-87aa-0168c9993503 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1452 microversion: 2.1 time: 0.161023 Sep 11 08:56:58.673594 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 529/1079] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:58 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:56:58.680513 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c567b6ae-40c4-4da8-b3c6-37005b99b5f2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:56:58.681133 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c567b6ae-40c4-4da8-b3c6-37005b99b5f2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:56:58.687422 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c567b6ae-40c4-4da8-b3c6-37005b99b5f2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:58.687853 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c567b6ae-40c4-4da8-b3c6-37005b99b5f2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:58.688295 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c567b6ae-40c4-4da8-b3c6-37005b99b5f2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:58.688998 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c567b6ae-40c4-4da8-b3c6-37005b99b5f2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:56:58.689454 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c567b6ae-40c4-4da8-b3c6-37005b99b5f2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:56:58.689935 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c567b6ae-40c4-4da8-b3c6-37005b99b5f2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:56:58.826768 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c567b6ae-40c4-4da8-b3c6-37005b99b5f2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:56:58.834803 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c567b6ae-40c4-4da8-b3c6-37005b99b5f2 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1452 microversion: 2.1 time: 0.158163 Sep 11 08:56:58.835376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 551/1080] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:56:58 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:01.098784 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-70887f71-d87e-4300-b7e6-dcc867a99d85 req-08517b83-295f-4cf7-87a5-ec10d86f269e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d102028f-9e13-426e-ae8e-dfc13f6ea147", "tag": "3f4adc04-6422-427d-b39e-78573123bcc9"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:57:01.109998 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-70887f71-d87e-4300-b7e6-dcc867a99d85 req-08517b83-295f-4cf7-87a5-ec10d86f269e service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:01.110514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-70887f71-d87e-4300-b7e6-dcc867a99d85 req-08517b83-295f-4cf7-87a5-ec10d86f269e service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:01.110933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-70887f71-d87e-4300-b7e6-dcc867a99d85 req-08517b83-295f-4cf7-87a5-ec10d86f269e service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:01.123690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-70887f71-d87e-4300-b7e6-dcc867a99d85 req-08517b83-295f-4cf7-87a5-ec10d86f269e service nova] Creating event network-changed:3f4adc04-6422-427d-b39e-78573123bcc9 for instance d102028f-9e13-426e-ae8e-dfc13f6ea147 on hv-cinder-85694 Sep 11 08:57:01.129614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-70887f71-d87e-4300-b7e6-dcc867a99d85 req-08517b83-295f-4cf7-87a5-ec10d86f269e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034961 Sep 11 08:57:01.130243 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 530/1081] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:57:01.509706 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0a632e84-d4cd-42b3-8245-ba4df27d95a0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:01.510310 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0a632e84-d4cd-42b3-8245-ba4df27d95a0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:01.516451 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0a632e84-d4cd-42b3-8245-ba4df27d95a0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:01.516954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0a632e84-d4cd-42b3-8245-ba4df27d95a0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:01.517869 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0a632e84-d4cd-42b3-8245-ba4df27d95a0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:01.518095 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0a632e84-d4cd-42b3-8245-ba4df27d95a0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:01.518756 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0a632e84-d4cd-42b3-8245-ba4df27d95a0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:01.519588 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0a632e84-d4cd-42b3-8245-ba4df27d95a0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:01.551114 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0a632e84-d4cd-42b3-8245-ba4df27d95a0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/ips" status: 200 len: 151 microversion: 2.1 time: 0.044457 Sep 11 08:57:01.552009 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 552/1082] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 08:57:01 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:57:03.262391 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2f90fe19-8848-45d1-97d5-783ae0b4a94c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4fa0326-e995-444f-8372-6ee93d34ce73"}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:57:03.264796 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2f90fe19-8848-45d1-97d5-783ae0b4a94c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:03.271082 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f90fe19-8848-45d1-97d5-783ae0b4a94c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:03.271570 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f90fe19-8848-45d1-97d5-783ae0b4a94c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:03.272011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f90fe19-8848-45d1-97d5-783ae0b4a94c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:03.272773 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f90fe19-8848-45d1-97d5-783ae0b4a94c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:03.273230 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f90fe19-8848-45d1-97d5-783ae0b4a94c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:03.273661 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2f90fe19-8848-45d1-97d5-783ae0b4a94c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:03.987212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2f90fe19-8848-45d1-97d5-783ae0b4a94c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729296 Sep 11 08:57:03.987903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 531/1083] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:57:03 2022] POST /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:57:11.543357 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4fa0326-e995-444f-8372-6ee93d34ce73"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:57:11.545690 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:11.548774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=28 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:11.549577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=66 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:11.554552 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:11.555034 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:11.557236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:11.557236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:11.557236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:11.557236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:11.636762 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Invalid volume: volume c4fa0326-e995-444f-8372-6ee93d34ce73 is already attached to instances: b99d9709-d14d-4d73-bb5d-1863a957082d Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: POST /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments HTTP/1.1 Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 74 Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:57:11.638554 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {"volumeAttachment": {"volumeId": "c4fa0326-e995-444f-8372-6ee93d34ce73"}} Sep 11 08:57:11.640222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Invalid volume: volume c4fa0326-e995-444f-8372-6ee93d34ce73 is already attached to instances: b99d9709-d14d-4d73-bb5d-1863a957082d Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'server_id': 'b99d9709-d14d-4d73-bb5d-1863a957082d', 'body': {'volumeAttachment': {'volumeId': 'c4fa0326-e995-444f-8372-6ee93d34ce73'}}} Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c4fa0326-e995-444f-8372-6ee93d34ce73 is already attached to instances: b99d9709-d14d-4d73-bb5d-1863a957082d Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:57:11.644479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c4fa0326-e995-444f-8372-6ee93d34ce73 is already attached to instances: b99d9709-d14d-4d73-bb5d-1863a957082d Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:57:11.646416 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:57:11.650720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:57:11.650720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:57:11.650720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:57:11.650720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c4fa0326-e995-444f-8372-6ee93d34ce73 is already attached to instances: b99d9709-d14d-4d73-bb5d-1863a957082d Sep 11 08:57:11.650720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:57:11.650720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 400 to user: Invalid volume: volume c4fa0326-e995-444f-8372-6ee93d34ce73 is already attached to instances: b99d9709-d14d-4d73-bb5d-1863a957082d {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:57:11.650720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-dcdcffa4-1e2e-48dd-8dbe-e4ef874dd615 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100620 Sep 11 08:57:11.650720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 553/1084] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:57:11 2022] POST /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 11 08:57:11.709450 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0c87853f-f6dd-48a0-b6fb-d95c7b0d7f74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:11.710060 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0c87853f-f6dd-48a0-b6fb-d95c7b0d7f74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:11.712290 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:11.719153 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c87853f-f6dd-48a0-b6fb-d95c7b0d7f74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:11.721024 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c87853f-f6dd-48a0-b6fb-d95c7b0d7f74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:11.721024 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c87853f-f6dd-48a0-b6fb-d95c7b0d7f74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:11.721024 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c87853f-f6dd-48a0-b6fb-d95c7b0d7f74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:11.721381 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c87853f-f6dd-48a0-b6fb-d95c7b0d7f74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:11.721720 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0c87853f-f6dd-48a0-b6fb-d95c7b0d7f74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:11.728560 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:11.814618 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-0c87853f-f6dd-48a0-b6fb-d95c7b0d7f74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lazy-loading 'services' on Instance uuid b99d9709-d14d-4d73-bb5d-1863a957082d {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:57:12.102523 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0c87853f-f6dd-48a0-b6fb-d95c7b0d7f74 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments/c4fa0326-e995-444f-8372-6ee93d34ce73" status: 202 len: 0 microversion: 2.1 time: 0.398226 Sep 11 08:57:12.103119 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 532/1085] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:57:11 2022] DELETE /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments/c4fa0326-e995-444f-8372-6ee93d34ce73 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:57:12.112879 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-08086486-bcc0-41a2-a781-00effdff2726 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:12.115357 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-08086486-bcc0-41a2-a781-00effdff2726 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:12.122029 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08086486-bcc0-41a2-a781-00effdff2726 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:12.122690 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08086486-bcc0-41a2-a781-00effdff2726 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:12.123118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08086486-bcc0-41a2-a781-00effdff2726 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:12.123813 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08086486-bcc0-41a2-a781-00effdff2726 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:12.124263 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08086486-bcc0-41a2-a781-00effdff2726 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:12.124676 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08086486-bcc0-41a2-a781-00effdff2726 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:12.156701 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-08086486-bcc0-41a2-a781-00effdff2726 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048933 Sep 11 08:57:12.157259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 554/1086] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:57:12 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:57:13.171336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-547f19ac-2996-4719-89a9-ab61405e9ba7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:13.173629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-547f19ac-2996-4719-89a9-ab61405e9ba7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:13.180461 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-547f19ac-2996-4719-89a9-ab61405e9ba7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:13.180950 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-547f19ac-2996-4719-89a9-ab61405e9ba7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:13.181392 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-547f19ac-2996-4719-89a9-ab61405e9ba7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:13.182103 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-547f19ac-2996-4719-89a9-ab61405e9ba7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:13.182587 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-547f19ac-2996-4719-89a9-ab61405e9ba7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:13.183018 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-547f19ac-2996-4719-89a9-ab61405e9ba7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:13.215857 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-547f19ac-2996-4719-89a9-ab61405e9ba7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049758 Sep 11 08:57:13.216576 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 533/1087] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:57:13 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:57:14.228890 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5c8d7d69-8b06-4244-af6e-fe61630e1a63 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:14.231092 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5c8d7d69-8b06-4244-af6e-fe61630e1a63 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:14.237293 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c8d7d69-8b06-4244-af6e-fe61630e1a63 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:14.237811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c8d7d69-8b06-4244-af6e-fe61630e1a63 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:14.238279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c8d7d69-8b06-4244-af6e-fe61630e1a63 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:14.238972 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c8d7d69-8b06-4244-af6e-fe61630e1a63 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:14.239467 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c8d7d69-8b06-4244-af6e-fe61630e1a63 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:14.239898 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5c8d7d69-8b06-4244-af6e-fe61630e1a63 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:14.268500 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5c8d7d69-8b06-4244-af6e-fe61630e1a63 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043878 Sep 11 08:57:14.269063 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 555/1088] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:57:14 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 08:57:14.348526 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-9eeb87c9-461e-42fa-b536-e37a1b293eee tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:14.349136 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9eeb87c9-461e-42fa-b536-e37a1b293eee tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:14.355505 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9eeb87c9-461e-42fa-b536-e37a1b293eee tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:14.355980 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9eeb87c9-461e-42fa-b536-e37a1b293eee tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:14.356412 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9eeb87c9-461e-42fa-b536-e37a1b293eee tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:14.357093 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9eeb87c9-461e-42fa-b536-e37a1b293eee tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:14.357543 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9eeb87c9-461e-42fa-b536-e37a1b293eee tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:14.357959 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-9eeb87c9-461e-42fa-b536-e37a1b293eee tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:14.383469 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-9eeb87c9-461e-42fa-b536-e37a1b293eee tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:57:14.669214 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-9eeb87c9-461e-42fa-b536-e37a1b293eee tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 204 len: 0 microversion: 2.1 time: 0.324255 Sep 11 08:57:14.669844 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 534/1089] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:57:14 2022] DELETE /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:57:14.684610 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b9958859-3c61-466f-83ea-8fba33071b42 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:14.685221 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b9958859-3c61-466f-83ea-8fba33071b42 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:14.691199 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9958859-3c61-466f-83ea-8fba33071b42 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:14.691686 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9958859-3c61-466f-83ea-8fba33071b42 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:14.692125 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9958859-3c61-466f-83ea-8fba33071b42 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:14.693394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9958859-3c61-466f-83ea-8fba33071b42 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:14.693851 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9958859-3c61-466f-83ea-8fba33071b42 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:14.694310 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b9958859-3c61-466f-83ea-8fba33071b42 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:14.835816 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b9958859-3c61-466f-83ea-8fba33071b42 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:14.844082 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b9958859-3c61-466f-83ea-8fba33071b42 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1683 microversion: 2.1 time: 0.163138 Sep 11 08:57:14.844706 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 556/1090] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:14 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:15.868052 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-f680b0e4-d5c4-406e-af8a-6802897019af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:15.868777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-f680b0e4-d5c4-406e-af8a-6802897019af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:15.875350 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f680b0e4-d5c4-406e-af8a-6802897019af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:15.875659 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f680b0e4-d5c4-406e-af8a-6802897019af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:15.876085 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f680b0e4-d5c4-406e-af8a-6802897019af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:15.876776 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f680b0e4-d5c4-406e-af8a-6802897019af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:15.877226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f680b0e4-d5c4-406e-af8a-6802897019af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:15.877646 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-f680b0e4-d5c4-406e-af8a-6802897019af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:16.013593 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-f680b0e4-d5c4-406e-af8a-6802897019af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:16.021478 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-f680b0e4-d5c4-406e-af8a-6802897019af tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1683 microversion: 2.1 time: 0.157990 Sep 11 08:57:16.022047 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 535/1091] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:15 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:17.045849 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c04c85f6-fb3b-4eda-a5d0-b66d94ff69dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:17.047223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c04c85f6-fb3b-4eda-a5d0-b66d94ff69dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:17.055920 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c04c85f6-fb3b-4eda-a5d0-b66d94ff69dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:17.058816 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c04c85f6-fb3b-4eda-a5d0-b66d94ff69dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:17.059366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c04c85f6-fb3b-4eda-a5d0-b66d94ff69dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:17.060214 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c04c85f6-fb3b-4eda-a5d0-b66d94ff69dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:17.060774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c04c85f6-fb3b-4eda-a5d0-b66d94ff69dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:17.061309 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c04c85f6-fb3b-4eda-a5d0-b66d94ff69dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:17.218707 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c04c85f6-fb3b-4eda-a5d0-b66d94ff69dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:17.227288 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c04c85f6-fb3b-4eda-a5d0-b66d94ff69dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1683 microversion: 2.1 time: 0.186524 Sep 11 08:57:17.227861 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 557/1092] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:17 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:17.594116 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-e9d19355-0984-44bb-a1ea-8fd1c953cc66 req-5638460f-4fc9-4db0-aa1b-b8201ed896fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99d9709-d14d-4d73-bb5d-1863a957082d", "name": "network-vif-deleted", "tag": "a607ef7a-9515-4094-beec-f1fd02d3f612"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:57:17.606645 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-e9d19355-0984-44bb-a1ea-8fd1c953cc66 req-5638460f-4fc9-4db0-aa1b-b8201ed896fa service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:17.607126 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-e9d19355-0984-44bb-a1ea-8fd1c953cc66 req-5638460f-4fc9-4db0-aa1b-b8201ed896fa service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:17.607581 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-e9d19355-0984-44bb-a1ea-8fd1c953cc66 req-5638460f-4fc9-4db0-aa1b-b8201ed896fa service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:17.620220 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-e9d19355-0984-44bb-a1ea-8fd1c953cc66 req-5638460f-4fc9-4db0-aa1b-b8201ed896fa service nova] Creating event network-vif-deleted:a607ef7a-9515-4094-beec-f1fd02d3f612 for instance b99d9709-d14d-4d73-bb5d-1863a957082d on hv-cinder-85694 Sep 11 08:57:17.625900 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-e9d19355-0984-44bb-a1ea-8fd1c953cc66 req-5638460f-4fc9-4db0-aa1b-b8201ed896fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037053 Sep 11 08:57:17.626731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 536/1093] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:57:18.252205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:18.253017 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:18.259990 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:18.260778 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:18.261223 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:18.261943 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:18.262433 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:18.263033 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:18.296172 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:18.296683 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:18.297082 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:18.297753 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lazy-loading 'fault' on Instance uuid b99d9709-d14d-4d73-bb5d-1863a957082d {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:57:18.365596 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:18.375159 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-63be9dfc-8576-4d47-9018-2a5f83efa53f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 200 len: 1331 microversion: 2.1 time: 0.126914 Sep 11 08:57:18.375747 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 558/1094] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:18 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:19.401180 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:19.402120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:19.408688 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:19.409291 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:19.409760 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:19.410572 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:19.411011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:19.411535 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:19.426001 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d HTTP/1.1 Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:57:19.427850 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:57:19.429794 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'b99d9709-d14d-4d73-bb5d-1863a957082d'} Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:57:19.430968 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:57:19.432871 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:57:19.435282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:57:19.435282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6ddc30c1-c1c5-479a-86fa-698c8218f255 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 404 len: 111 microversion: 2.1 time: 0.032458 Sep 11 08:57:19.435282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 537/1095] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:19 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:57:19.439307 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e4908eab-75da-4d29-bbff-b2a78678823f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '.version_select at 0x7fb27ea5fdc0>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:19.547973 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e4908eab-75da-4d29-bbff-b2a78678823f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018074376" status: 202 len: 0 microversion: 2.1 time: 0.111932 Sep 11 08:57:19.548999 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 559/1096] 10.222.0.44 () {58 vars in 1221 bytes} [Sun Sep 11 08:57:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018074376 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:57:20.372608 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-dcdd9ef3-d54d-4f3b-bb9b-cb7243e72e76 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: .version_select at 0x7fb27edda550>, body: {"keypair": {"name": "tempest-keypair-1294016588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7JOpZQ3Hut5uy/zHylg74+Lg4Jos/V+ngpS2mBB4pIDF8CUg4f3TEhAxVdVlCQqkZXUXbEzU3KAmkfSltXvlktvLi4OaANe7eCvOrz96QoPX6y8nIU9Rvxk9yVjnhSQg=="}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:57:20.387393 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-dcdd9ef3-d54d-4f3b-bb9b-cb7243e72e76 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for project c0401850bdf44aaaa6c37ed752708f53. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:57:20.391139 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.quota [None req-dcdd9ef3-d54d-4f3b-bb9b-cb7243e72e76 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for user c1c1de0489104713a90c59b89a284321 and project c0401850bdf44aaaa6c37ed752708f53. Resources: {'key_pairs'} {{(pid=127647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:57:20.488120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-dcdd9ef3-d54d-4f3b-bb9b-cb7243e72e76 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119224 Sep 11 08:57:20.488769 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 538/1097] 10.222.0.44 () {60 vars in 1159 bytes} [Sun Sep 11 08:57:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:57:23.007277 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-937712080", "imageRef": "6441b3d1-99f2-4856-a5ee-6f8ae4e3be50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14f105a2-32ea-4014-a77a-841402520d71"}], "security_groups": [{"name": "tempest-securitygroup--1542674990"}], "key_name": "tempest-keypair-1294016588", "user_data": "}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:57:23.111098 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] validate_networks() for [('14f105a2-32ea-4014-a77a-841402520d71', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:57:23.616458 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:57:23.616878 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:57:23.617394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:57:23.617793 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:57:23.618236 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:57:23.626836 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:23.627316 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:23.627747 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:23.628466 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:23.628911 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:23.629329 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:23.646699 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for project c0401850bdf44aaaa6c37ed752708f53. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:57:23.650569 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Getting quotas for user c1c1de0489104713a90c59b89a284321 and project c0401850bdf44aaaa6c37ed752708f53. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:57:23.661970 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:57:23.664279 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6441b3d1-99f2-4856-a5ee-6f8ae4e3be50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:57:23.825206 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-959706d1-f4a8-4754-ac68-fb062d59f54d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.823753 Sep 11 08:57:23.826028 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 560/1098] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:57:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:57:23.837757 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-bb1fc876-c1b3-442c-bc3e-8f1957d9dcaa tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:23.838397 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-bb1fc876-c1b3-442c-bc3e-8f1957d9dcaa tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:23.904848 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-bb1fc876-c1b3-442c-bc3e-8f1957d9dcaa tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:23.911701 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-bb1fc876-c1b3-442c-bc3e-8f1957d9dcaa tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1241 microversion: 2.1 time: 0.077843 Sep 11 08:57:23.912267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 539/1099] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:23 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:24.934118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6085bc2e-0107-465f-9fe7-b7afdfef3bb0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:24.934993 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6085bc2e-0107-465f-9fe7-b7afdfef3bb0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:24.941136 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6085bc2e-0107-465f-9fe7-b7afdfef3bb0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:24.941622 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6085bc2e-0107-465f-9fe7-b7afdfef3bb0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:24.942056 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6085bc2e-0107-465f-9fe7-b7afdfef3bb0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:24.942795 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6085bc2e-0107-465f-9fe7-b7afdfef3bb0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:24.943247 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6085bc2e-0107-465f-9fe7-b7afdfef3bb0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:24.943669 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6085bc2e-0107-465f-9fe7-b7afdfef3bb0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:25.008918 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6085bc2e-0107-465f-9fe7-b7afdfef3bb0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:25.017211 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6085bc2e-0107-465f-9fe7-b7afdfef3bb0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1245 microversion: 2.1 time: 0.087492 Sep 11 08:57:25.017788 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 561/1100] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:24 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:26.041266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ffe4930b-82b9-461b-a7a0-f731f0666425 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:26.041862 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ffe4930b-82b9-461b-a7a0-f731f0666425 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:26.048547 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffe4930b-82b9-461b-a7a0-f731f0666425 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:26.049045 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffe4930b-82b9-461b-a7a0-f731f0666425 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:26.049546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffe4930b-82b9-461b-a7a0-f731f0666425 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:26.050280 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffe4930b-82b9-461b-a7a0-f731f0666425 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:26.050738 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffe4930b-82b9-461b-a7a0-f731f0666425 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:26.051168 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ffe4930b-82b9-461b-a7a0-f731f0666425 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:26.123883 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ffe4930b-82b9-461b-a7a0-f731f0666425 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:26.133862 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ffe4930b-82b9-461b-a7a0-f731f0666425 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1301 microversion: 2.1 time: 0.096359 Sep 11 08:57:26.142230 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 540/1101] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:26 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1301 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:27.162507 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e99d343c-fb13-4d2a-b3d4-66eeb4cd7432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:27.163290 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e99d343c-fb13-4d2a-b3d4-66eeb4cd7432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:27.170632 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e99d343c-fb13-4d2a-b3d4-66eeb4cd7432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:27.171259 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e99d343c-fb13-4d2a-b3d4-66eeb4cd7432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:27.171863 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e99d343c-fb13-4d2a-b3d4-66eeb4cd7432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:27.172933 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e99d343c-fb13-4d2a-b3d4-66eeb4cd7432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:27.173442 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e99d343c-fb13-4d2a-b3d4-66eeb4cd7432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:27.174064 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e99d343c-fb13-4d2a-b3d4-66eeb4cd7432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:27.386931 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e99d343c-fb13-4d2a-b3d4-66eeb4cd7432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:27.395090 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e99d343c-fb13-4d2a-b3d4-66eeb4cd7432 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1367 microversion: 2.1 time: 0.236984 Sep 11 08:57:27.398097 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 562/1102] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:27 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:28.423207 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fb585e81-9d5c-4817-a8f9-571f780c5f6d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:28.423911 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-fb585e81-9d5c-4817-a8f9-571f780c5f6d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:28.431590 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb585e81-9d5c-4817-a8f9-571f780c5f6d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:28.432853 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb585e81-9d5c-4817-a8f9-571f780c5f6d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:28.432853 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb585e81-9d5c-4817-a8f9-571f780c5f6d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:28.433609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb585e81-9d5c-4817-a8f9-571f780c5f6d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:28.434070 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb585e81-9d5c-4817-a8f9-571f780c5f6d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:28.434534 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fb585e81-9d5c-4817-a8f9-571f780c5f6d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:28.460240 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-826dc4f0-f010-40ed-be21-5d5a7a22f1d6 req-f791479d-04fe-495b-ba07-6a246ca63f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7eda7ef-de1a-4c18-b912-df40f054463e", "tag": "cd5f9e24-5c57-4f44-89d1-009130c2d7c8"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:57:28.471063 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-826dc4f0-f010-40ed-be21-5d5a7a22f1d6 req-f791479d-04fe-495b-ba07-6a246ca63f50 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:28.471548 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-826dc4f0-f010-40ed-be21-5d5a7a22f1d6 req-f791479d-04fe-495b-ba07-6a246ca63f50 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:28.472068 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-826dc4f0-f010-40ed-be21-5d5a7a22f1d6 req-f791479d-04fe-495b-ba07-6a246ca63f50 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:28.484563 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-826dc4f0-f010-40ed-be21-5d5a7a22f1d6 req-f791479d-04fe-495b-ba07-6a246ca63f50 service nova] Creating event network-changed:cd5f9e24-5c57-4f44-89d1-009130c2d7c8 for instance b7eda7ef-de1a-4c18-b912-df40f054463e on hv-cinder-85694 Sep 11 08:57:28.491112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-826dc4f0-f010-40ed-be21-5d5a7a22f1d6 req-f791479d-04fe-495b-ba07-6a246ca63f50 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183591 Sep 11 08:57:28.491788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 541/1103] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:57:28.672002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fb585e81-9d5c-4817-a8f9-571f780c5f6d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:28.680785 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-fb585e81-9d5c-4817-a8f9-571f780c5f6d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1367 microversion: 2.1 time: 0.265418 Sep 11 08:57:28.681687 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 563/1104] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:28 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:57:29.705194 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7b7ae1b3-4720-47cf-8c70-4f032f922cbd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:29.705922 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-7b7ae1b3-4720-47cf-8c70-4f032f922cbd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:29.712189 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b7ae1b3-4720-47cf-8c70-4f032f922cbd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:29.712676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b7ae1b3-4720-47cf-8c70-4f032f922cbd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:29.713114 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b7ae1b3-4720-47cf-8c70-4f032f922cbd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:29.713823 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b7ae1b3-4720-47cf-8c70-4f032f922cbd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:29.714308 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b7ae1b3-4720-47cf-8c70-4f032f922cbd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:29.714731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-7b7ae1b3-4720-47cf-8c70-4f032f922cbd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:29.853887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-7b7ae1b3-4720-47cf-8c70-4f032f922cbd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:29.866666 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-7b7ae1b3-4720-47cf-8c70-4f032f922cbd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1367 microversion: 2.1 time: 0.161142 Sep 11 08:57:29.866666 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 542/1105] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:29 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:30.886305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3a404815-4caf-4d65-9ce0-aff8c4e3036c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:30.886918 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3a404815-4caf-4d65-9ce0-aff8c4e3036c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:30.893579 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a404815-4caf-4d65-9ce0-aff8c4e3036c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:30.894058 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a404815-4caf-4d65-9ce0-aff8c4e3036c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:30.894514 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a404815-4caf-4d65-9ce0-aff8c4e3036c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:30.895849 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a404815-4caf-4d65-9ce0-aff8c4e3036c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:30.896299 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a404815-4caf-4d65-9ce0-aff8c4e3036c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:30.896723 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3a404815-4caf-4d65-9ce0-aff8c4e3036c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:31.046297 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3a404815-4caf-4d65-9ce0-aff8c4e3036c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:31.054804 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3a404815-4caf-4d65-9ce0-aff8c4e3036c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1367 microversion: 2.1 time: 0.172449 Sep 11 08:57:31.055366 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 564/1106] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:30 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:32.078356 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3032d2ca-e155-4151-87b8-b3eed672c570 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:32.078971 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3032d2ca-e155-4151-87b8-b3eed672c570 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:32.085981 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3032d2ca-e155-4151-87b8-b3eed672c570 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:32.086494 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3032d2ca-e155-4151-87b8-b3eed672c570 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:32.086926 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3032d2ca-e155-4151-87b8-b3eed672c570 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:32.087690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3032d2ca-e155-4151-87b8-b3eed672c570 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:32.088136 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3032d2ca-e155-4151-87b8-b3eed672c570 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:32.088552 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3032d2ca-e155-4151-87b8-b3eed672c570 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:32.224329 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3032d2ca-e155-4151-87b8-b3eed672c570 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:32.233276 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3032d2ca-e155-4151-87b8-b3eed672c570 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1367 microversion: 2.1 time: 0.158816 Sep 11 08:57:32.234482 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 543/1107] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:32 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:33.256769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-ca87606a-0edb-493a-b0cf-4895dec5a28f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:33.257420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-ca87606a-0edb-493a-b0cf-4895dec5a28f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:33.263977 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca87606a-0edb-493a-b0cf-4895dec5a28f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:33.264456 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca87606a-0edb-493a-b0cf-4895dec5a28f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:33.264895 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca87606a-0edb-493a-b0cf-4895dec5a28f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:33.265586 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca87606a-0edb-493a-b0cf-4895dec5a28f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:33.266082 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca87606a-0edb-493a-b0cf-4895dec5a28f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:33.266526 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-ca87606a-0edb-493a-b0cf-4895dec5a28f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:33.399948 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-ca87606a-0edb-493a-b0cf-4895dec5a28f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:33.407808 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-ca87606a-0edb-493a-b0cf-4895dec5a28f tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1367 microversion: 2.1 time: 0.155142 Sep 11 08:57:33.408413 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 565/1108] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:33 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:34.164880 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-8fabd7bc-34ea-429e-b1ba-069c63570664 req-081ed030-f56b-4883-9fed-214a5fb93ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7eda7ef-de1a-4c18-b912-df40f054463e", "name": "network-vif-plugged", "status": "completed", "tag": "cd5f9e24-5c57-4f44-89d1-009130c2d7c8"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:57:34.171392 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=6 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:34.177586 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-8fabd7bc-34ea-429e-b1ba-069c63570664 req-081ed030-f56b-4883-9fed-214a5fb93ed7 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:34.178069 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-8fabd7bc-34ea-429e-b1ba-069c63570664 req-081ed030-f56b-4883-9fed-214a5fb93ed7 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:34.178525 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-8fabd7bc-34ea-429e-b1ba-069c63570664 req-081ed030-f56b-4883-9fed-214a5fb93ed7 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:34.190432 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-8fabd7bc-34ea-429e-b1ba-069c63570664 req-081ed030-f56b-4883-9fed-214a5fb93ed7 service nova] Creating event network-vif-plugged:cd5f9e24-5c57-4f44-89d1-009130c2d7c8 for instance b7eda7ef-de1a-4c18-b912-df40f054463e on hv-cinder-85694 Sep 11 08:57:34.196232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-8fabd7bc-34ea-429e-b1ba-069c63570664 req-081ed030-f56b-4883-9fed-214a5fb93ed7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035140 Sep 11 08:57:34.200825 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 544/1109] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:57:34.432539 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-68348728-a53f-4580-bebe-61d0357b3c19 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:34.433110 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-68348728-a53f-4580-bebe-61d0357b3c19 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:34.435046 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:34.441045 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=6 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:57:34.441045 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68348728-a53f-4580-bebe-61d0357b3c19 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:34.441506 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68348728-a53f-4580-bebe-61d0357b3c19 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:34.441841 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68348728-a53f-4580-bebe-61d0357b3c19 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:34.442715 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68348728-a53f-4580-bebe-61d0357b3c19 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:34.443038 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68348728-a53f-4580-bebe-61d0357b3c19 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:34.443455 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-68348728-a53f-4580-bebe-61d0357b3c19 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:34.584739 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-68348728-a53f-4580-bebe-61d0357b3c19 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:34.592967 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-68348728-a53f-4580-bebe-61d0357b3c19 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1367 microversion: 2.1 time: 0.165333 Sep 11 08:57:34.593563 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 566/1110] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:34 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:35.619338 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b273c53c-fda6-485e-aa41-2cf0e38a8a49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:35.620079 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b273c53c-fda6-485e-aa41-2cf0e38a8a49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:35.627126 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b273c53c-fda6-485e-aa41-2cf0e38a8a49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:35.627614 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b273c53c-fda6-485e-aa41-2cf0e38a8a49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:35.628052 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b273c53c-fda6-485e-aa41-2cf0e38a8a49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:35.628784 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b273c53c-fda6-485e-aa41-2cf0e38a8a49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:35.629936 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b273c53c-fda6-485e-aa41-2cf0e38a8a49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:35.630403 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b273c53c-fda6-485e-aa41-2cf0e38a8a49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:35.793795 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-b273c53c-fda6-485e-aa41-2cf0e38a8a49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:35.802189 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b273c53c-fda6-485e-aa41-2cf0e38a8a49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1367 microversion: 2.1 time: 0.188654 Sep 11 08:57:35.802930 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 545/1111] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:35 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:36.825520 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9539b8d6-55ef-42cb-b0d3-831b9cb50c21 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:36.826569 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9539b8d6-55ef-42cb-b0d3-831b9cb50c21 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:36.833980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9539b8d6-55ef-42cb-b0d3-831b9cb50c21 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:36.835412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9539b8d6-55ef-42cb-b0d3-831b9cb50c21 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:36.835412 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9539b8d6-55ef-42cb-b0d3-831b9cb50c21 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:36.835977 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9539b8d6-55ef-42cb-b0d3-831b9cb50c21 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:36.836108 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9539b8d6-55ef-42cb-b0d3-831b9cb50c21 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:36.836495 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9539b8d6-55ef-42cb-b0d3-831b9cb50c21 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:36.979423 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9539b8d6-55ef-42cb-b0d3-831b9cb50c21 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:57:36.993522 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9539b8d6-55ef-42cb-b0d3-831b9cb50c21 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1558 microversion: 2.1 time: 0.172231 Sep 11 08:57:36.994114 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 567/1112] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:57:36 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:57:37.016430 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-27369a8a-68c9-4a56-b4d2-e740dc1b6589 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:57:37.016963 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-27369a8a-68c9-4a56-b4d2-e740dc1b6589 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:57:37.023398 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27369a8a-68c9-4a56-b4d2-e740dc1b6589 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:37.023937 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27369a8a-68c9-4a56-b4d2-e740dc1b6589 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:37.024323 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27369a8a-68c9-4a56-b4d2-e740dc1b6589 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:37.025023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27369a8a-68c9-4a56-b4d2-e740dc1b6589 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:37.025478 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27369a8a-68c9-4a56-b4d2-e740dc1b6589 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:37.025904 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-27369a8a-68c9-4a56-b4d2-e740dc1b6589 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:37.118023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-27369a8a-68c9-4a56-b4d2-e740dc1b6589 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105456 Sep 11 08:57:37.118676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 546/1113] 10.222.0.44 () {58 vars in 1275 bytes} [Sun Sep 11 08:57:37 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:57:38.432096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-b49a5d8d-4198-4fc3-b4a3-5ed92b90e7dd req-b67f3f86-573e-4c82-9aa1-4c34d599c7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7eda7ef-de1a-4c18-b912-df40f054463e", "tag": "cd5f9e24-5c57-4f44-89d1-009130c2d7c8"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:57:38.442870 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-b49a5d8d-4198-4fc3-b4a3-5ed92b90e7dd req-b67f3f86-573e-4c82-9aa1-4c34d599c7e8 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:57:38.443444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-b49a5d8d-4198-4fc3-b4a3-5ed92b90e7dd req-b67f3f86-573e-4c82-9aa1-4c34d599c7e8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:57:38.443952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-b49a5d8d-4198-4fc3-b4a3-5ed92b90e7dd req-b67f3f86-573e-4c82-9aa1-4c34d599c7e8 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:57:38.455601 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-b49a5d8d-4198-4fc3-b4a3-5ed92b90e7dd req-b67f3f86-573e-4c82-9aa1-4c34d599c7e8 service nova] Creating event network-changed:cd5f9e24-5c57-4f44-89d1-009130c2d7c8 for instance b7eda7ef-de1a-4c18-b912-df40f054463e on hv-cinder-85694 Sep 11 08:57:38.462499 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-b49a5d8d-4198-4fc3-b4a3-5ed92b90e7dd req-b67f3f86-573e-4c82-9aa1-4c34d599c7e8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033765 Sep 11 08:57:38.463112 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 568/1114] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:58:12.475192 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:12.476604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:12.480782 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a4ae2bc7-06af-4bb5-b49a-fe37f724e5fe tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:12.481271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a4ae2bc7-06af-4bb5-b49a-fe37f724e5fe tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:12.487683 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a4ae2bc7-06af-4bb5-b49a-fe37f724e5fe tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:12.488172 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a4ae2bc7-06af-4bb5-b49a-fe37f724e5fe tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:12.488610 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a4ae2bc7-06af-4bb5-b49a-fe37f724e5fe tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:12.489316 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a4ae2bc7-06af-4bb5-b49a-fe37f724e5fe tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:12.489768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a4ae2bc7-06af-4bb5-b49a-fe37f724e5fe tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:12.490217 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a4ae2bc7-06af-4bb5-b49a-fe37f724e5fe tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:12.516164 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a4ae2bc7-06af-4bb5-b49a-fe37f724e5fe tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/ips" status: 200 len: 150 microversion: 2.1 time: 0.042864 Sep 11 08:58:12.516761 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 547/1115] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 08:58:12 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:14.408947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:14.409708 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=84 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:14.414701 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-bdf2e056-e290-440a-ac8e-991d51cc59e6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "057f899b-ac3b-48d8-919a-2ea727bea30a"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:58:14.417409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-bdf2e056-e290-440a-ac8e-991d51cc59e6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:14.424049 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdf2e056-e290-440a-ac8e-991d51cc59e6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:14.424535 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdf2e056-e290-440a-ac8e-991d51cc59e6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:14.424968 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdf2e056-e290-440a-ac8e-991d51cc59e6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:14.425690 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdf2e056-e290-440a-ac8e-991d51cc59e6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:14.426188 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdf2e056-e290-440a-ac8e-991d51cc59e6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:14.426609 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bdf2e056-e290-440a-ac8e-991d51cc59e6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:15.466867 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-bdf2e056-e290-440a-ac8e-991d51cc59e6 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "POST /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.059309 Sep 11 08:58:15.467527 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 569/1116] 10.222.0.44 () {60 vars in 1323 bytes} [Sun Sep 11 08:58:14 2022] POST /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-volume_attachments => generated 194 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:23.152974 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-590d90b4-b174-47bd-9a59-149bf84ef4a1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:23.153517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-590d90b4-b174-47bd-9a59-149bf84ef4a1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:23.160940 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-590d90b4-b174-47bd-9a59-149bf84ef4a1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:23.161419 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-590d90b4-b174-47bd-9a59-149bf84ef4a1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:23.161851 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-590d90b4-b174-47bd-9a59-149bf84ef4a1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:23.162565 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-590d90b4-b174-47bd-9a59-149bf84ef4a1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:23.163015 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-590d90b4-b174-47bd-9a59-149bf84ef4a1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:23.163438 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-590d90b4-b174-47bd-9a59-149bf84ef4a1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:23.246901 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-590d90b4-b174-47bd-9a59-149bf84ef4a1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lazy-loading 'services' on Instance uuid b7eda7ef-de1a-4c18-b912-df40f054463e {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:58:23.456533 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-590d90b4-b174-47bd-9a59-149bf84ef4a1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-volume_attachments/057f899b-ac3b-48d8-919a-2ea727bea30a" status: 202 len: 0 microversion: 2.1 time: 0.308298 Sep 11 08:58:23.457041 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 548/1117] 10.222.0.44 () {58 vars in 1416 bytes} [Sun Sep 11 08:58:23 2022] DELETE /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-volume_attachments/057f899b-ac3b-48d8-919a-2ea727bea30a => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:58:23.467420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-97381e4e-1e24-41f7-a5f6-20695f45005d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:23.469783 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-97381e4e-1e24-41f7-a5f6-20695f45005d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:23.476089 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97381e4e-1e24-41f7-a5f6-20695f45005d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:23.476573 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97381e4e-1e24-41f7-a5f6-20695f45005d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:23.477064 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97381e4e-1e24-41f7-a5f6-20695f45005d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:23.477803 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97381e4e-1e24-41f7-a5f6-20695f45005d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:23.478255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97381e4e-1e24-41f7-a5f6-20695f45005d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:23.478680 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-97381e4e-1e24-41f7-a5f6-20695f45005d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:23.509253 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-97381e4e-1e24-41f7-a5f6-20695f45005d tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047385 Sep 11 08:58:23.509817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 570/1118] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:58:23 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:24.523257 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e24814bc-83bb-45e3-9c58-ca59f5c1062c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:24.526119 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e24814bc-83bb-45e3-9c58-ca59f5c1062c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:24.532511 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e24814bc-83bb-45e3-9c58-ca59f5c1062c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:24.533002 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e24814bc-83bb-45e3-9c58-ca59f5c1062c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:24.533437 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e24814bc-83bb-45e3-9c58-ca59f5c1062c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:24.534213 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e24814bc-83bb-45e3-9c58-ca59f5c1062c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:24.534668 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e24814bc-83bb-45e3-9c58-ca59f5c1062c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:24.535099 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e24814bc-83bb-45e3-9c58-ca59f5c1062c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:24.567519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e24814bc-83bb-45e3-9c58-ca59f5c1062c tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049306 Sep 11 08:58:24.568072 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 549/1119] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:58:24 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:25.580686 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b3e7b747-eb36-4db8-9982-8ad5561becc1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:25.582863 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b3e7b747-eb36-4db8-9982-8ad5561becc1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:25.589866 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3e7b747-eb36-4db8-9982-8ad5561becc1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:25.590383 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3e7b747-eb36-4db8-9982-8ad5561becc1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:25.590811 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3e7b747-eb36-4db8-9982-8ad5561becc1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:25.591495 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3e7b747-eb36-4db8-9982-8ad5561becc1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:25.591943 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3e7b747-eb36-4db8-9982-8ad5561becc1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:25.592367 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b3e7b747-eb36-4db8-9982-8ad5561becc1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:25.622374 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b3e7b747-eb36-4db8-9982-8ad5561becc1 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045607 Sep 11 08:58:25.622946 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 571/1120] 10.222.0.44 () {58 vars in 1302 bytes} [Sun Sep 11 08:58:25 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 11 08:58:25.690127 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e8dfe86d-166a-42cc-b33c-92055f2d6a89 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:25.690726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e8dfe86d-166a-42cc-b33c-92055f2d6a89 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:25.698358 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e8dfe86d-166a-42cc-b33c-92055f2d6a89 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:25.698861 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e8dfe86d-166a-42cc-b33c-92055f2d6a89 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:25.699305 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e8dfe86d-166a-42cc-b33c-92055f2d6a89 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:25.700052 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e8dfe86d-166a-42cc-b33c-92055f2d6a89 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:25.700513 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e8dfe86d-166a-42cc-b33c-92055f2d6a89 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:25.700943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e8dfe86d-166a-42cc-b33c-92055f2d6a89 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:25.728288 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e8dfe86d-166a-42cc-b33c-92055f2d6a89 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:58:26.073058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e8dfe86d-166a-42cc-b33c-92055f2d6a89 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 204 len: 0 microversion: 2.1 time: 0.386897 Sep 11 08:58:26.073651 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 550/1121] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:58:25 2022] DELETE /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:58:26.082082 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c392c36b-4e10-419b-bbaf-275ee73aad97 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:26.082720 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c392c36b-4e10-419b-bbaf-275ee73aad97 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:26.089460 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c392c36b-4e10-419b-bbaf-275ee73aad97 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:26.089935 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c392c36b-4e10-419b-bbaf-275ee73aad97 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:26.090393 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c392c36b-4e10-419b-bbaf-275ee73aad97 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:26.091075 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c392c36b-4e10-419b-bbaf-275ee73aad97 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:26.091518 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c392c36b-4e10-419b-bbaf-275ee73aad97 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:26.091938 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c392c36b-4e10-419b-bbaf-275ee73aad97 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:26.223774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c392c36b-4e10-419b-bbaf-275ee73aad97 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:58:26.231654 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c392c36b-4e10-419b-bbaf-275ee73aad97 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1682 microversion: 2.1 time: 0.153483 Sep 11 08:58:26.232233 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 572/1122] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:58:26 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:58:27.256690 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-88eff150-ab78-4b37-8a6c-67670fc6ad46 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:27.257337 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-88eff150-ab78-4b37-8a6c-67670fc6ad46 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:27.263731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88eff150-ab78-4b37-8a6c-67670fc6ad46 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:27.264207 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88eff150-ab78-4b37-8a6c-67670fc6ad46 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:27.264641 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88eff150-ab78-4b37-8a6c-67670fc6ad46 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:27.265348 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88eff150-ab78-4b37-8a6c-67670fc6ad46 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:27.265796 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88eff150-ab78-4b37-8a6c-67670fc6ad46 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:27.266242 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-88eff150-ab78-4b37-8a6c-67670fc6ad46 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:27.401940 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-88eff150-ab78-4b37-8a6c-67670fc6ad46 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:58:27.409817 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-88eff150-ab78-4b37-8a6c-67670fc6ad46 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1682 microversion: 2.1 time: 0.157444 Sep 11 08:58:27.410328 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 551/1123] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:58:27 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:58:28.498017 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-7d15c3a1-b054-4f76-91e7-fd11457da16e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:28.498657 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-7d15c3a1-b054-4f76-91e7-fd11457da16e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:28.504885 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d15c3a1-b054-4f76-91e7-fd11457da16e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:28.505376 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d15c3a1-b054-4f76-91e7-fd11457da16e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:28.505806 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d15c3a1-b054-4f76-91e7-fd11457da16e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:28.506614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d15c3a1-b054-4f76-91e7-fd11457da16e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:28.507063 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d15c3a1-b054-4f76-91e7-fd11457da16e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:28.507487 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-7d15c3a1-b054-4f76-91e7-fd11457da16e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:28.578682 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-7d15c3a1-b054-4f76-91e7-fd11457da16e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:58:28.586817 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-7d15c3a1-b054-4f76-91e7-fd11457da16e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1614 microversion: 2.1 time: 0.157363 Sep 11 08:58:28.587409 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 573/1124] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:58:28 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1614 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:58:28.744802 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-dc5fbcec-05e8-408d-a0c7-7db2e133b1d9 req-a95f7300-7238-4945-a6e9-9838d74d5d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7eda7ef-de1a-4c18-b912-df40f054463e", "name": "network-vif-deleted", "tag": "cd5f9e24-5c57-4f44-89d1-009130c2d7c8"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:58:28.755176 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-dc5fbcec-05e8-408d-a0c7-7db2e133b1d9 req-a95f7300-7238-4945-a6e9-9838d74d5d2c service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:28.755658 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-dc5fbcec-05e8-408d-a0c7-7db2e133b1d9 req-a95f7300-7238-4945-a6e9-9838d74d5d2c service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:28.756120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-dc5fbcec-05e8-408d-a0c7-7db2e133b1d9 req-a95f7300-7238-4945-a6e9-9838d74d5d2c service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:28.768304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-dc5fbcec-05e8-408d-a0c7-7db2e133b1d9 req-a95f7300-7238-4945-a6e9-9838d74d5d2c service nova] Creating event network-vif-deleted:cd5f9e24-5c57-4f44-89d1-009130c2d7c8 for instance b7eda7ef-de1a-4c18-b912-df40f054463e on hv-cinder-85694 Sep 11 08:58:28.779444 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-dc5fbcec-05e8-408d-a0c7-7db2e133b1d9 req-a95f7300-7238-4945-a6e9-9838d74d5d2c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032864 Sep 11 08:58:28.779444 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 552/1125] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:29.614943 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:29.615684 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:29.623183 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:29.623679 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:29.624125 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:29.624833 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:29.625286 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:29.625709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:29.660938 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:29.661433 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:29.661868 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:29.662364 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lazy-loading 'fault' on Instance uuid b7eda7ef-de1a-4c18-b912-df40f054463e {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:58:29.709717 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c1de0489104713a90c59b89a284321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0401850bdf44aaaa6c37ed752708f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:58:29.720952 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6f0eacad-fafe-44f2-970b-c885485cffd0 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 200 len: 1331 microversion: 2.1 time: 0.110216 Sep 11 08:58:29.721849 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 574/1126] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:58:29 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:58:30.745564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:30.746283 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:30.752542 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:30.753023 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:30.753459 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:30.754168 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:30.754633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:30.755059 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:30.768848 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e HTTP/1.1 Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:58:30.770517 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:30.772325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'b7eda7ef-de1a-4c18-b912-df40f054463e'} Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:30.773300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:30.775580 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:30.777072 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:30.777072 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-c6fade79-162d-4a72-b461-e8d7c6a11b1e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 404 len: 111 microversion: 2.1 time: 0.031087 Sep 11 08:58:30.777072 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 553/1127] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:58:30 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:30.781683 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-02a4ebb7-444a-40f3-9312-2668b69947ea tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '.version_select at 0x7fb27ebdc670>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:30.875986 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-02a4ebb7-444a-40f3-9312-2668b69947ea tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294016588" status: 202 len: 0 microversion: 2.1 time: 0.098090 Sep 11 08:58:30.876750 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 575/1128] 10.222.0.44 () {58 vars in 1221 bytes} [Sun Sep 11 08:58:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294016588 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:58:32.956524 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:32.957068 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:32.964785 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:32.965410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:32.965876 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:32.966700 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:32.967263 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:32.967695 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:32.983226 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: DELETE /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e HTTP/1.1 Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:58:32.984860 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:32.986528 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'b7eda7ef-de1a-4c18-b912-df40f054463e'} Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:32.987300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:32.988814 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:32.990212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:32.990212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-50eecdd6-75eb-4604-8323-b131a3bc57f7 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 404 len: 111 microversion: 2.1 time: 0.033817 Sep 11 08:58:32.990212 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 554/1129] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:58:32 2022] DELETE /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:32.996652 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:32.997269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b7eda7ef-de1a-4c18-b912-df40f054463e] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:33.004303 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:33.004786 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:33.005217 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:33.005905 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:33.006385 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:33.006804 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:33.020387 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e HTTP/1.1 Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:58:33.022039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:33.024577 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'b7eda7ef-de1a-4c18-b912-df40f054463e'} Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:33.026394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. Sep 11 08:58:33.029117 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:33.031118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance b7eda7ef-de1a-4c18-b912-df40f054463e could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:33.031118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-bcdddd35-163c-44dc-836f-0aeba3678628 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e" status: 404 len: 111 microversion: 2.1 time: 0.031863 Sep 11 08:58:33.031118 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 576/1130] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:58:32 2022] GET /compute/v2.1/servers/b7eda7ef-de1a-4c18-b912-df40f054463e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:34.357378 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:34.357915 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:34.365304 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:34.365788 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:34.366254 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:34.366956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:34.367405 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:34.367824 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:34.382939 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: DELETE /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d HTTP/1.1 Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:58:34.385225 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:58:34.386849 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'b99d9709-d14d-4d73-bb5d-1863a957082d'} Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:34.388583 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:58:34.389810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.391578 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:34.391578 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-b6217430-93fe-409a-a0c2-0e426ab15b93 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 404 len: 111 microversion: 2.1 time: 0.033208 Sep 11 08:58:34.391578 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 555/1131] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:58:34 2022] DELETE /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:34.395404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:34.396024 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: b99d9709-d14d-4d73-bb5d-1863a957082d] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:34.405022 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:34.405505 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:34.405941 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:34.406701 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:34.407153 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:34.407578 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:34.423222 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d HTTP/1.1 Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:58:34.424743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:58:34.426394 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'b99d9709-d14d-4d73-bb5d-1863a957082d'} Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:34.427428 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. Sep 11 08:58:34.428892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.430140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance b99d9709-d14d-4d73-bb5d-1863a957082d could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:34.430140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-6ab76308-d6ee-4afc-8c67-d6bf7eb11e49 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d" status: 404 len: 111 microversion: 2.1 time: 0.034622 Sep 11 08:58:34.430140 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 577/1132] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:58:34 2022] GET /compute/v2.1/servers/b99d9709-d14d-4d73-bb5d-1863a957082d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:34.436061 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:34.436553 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:34.442604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:34.443224 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:34.443525 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:34.444235 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:34.450415 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:34.451050 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:34.466375 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: DELETE /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 HTTP/1.1 Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:58:34.467943 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:58:34.469564 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'ff049257-22d8-414c-9ad2-c5e2c33470b9'} Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:34.470451 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:58:34.472081 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.473558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:34.473558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0dbbd817-b2a2-4178-88d9-93495ef48d45 tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 404 len: 111 microversion: 2.1 time: 0.037610 Sep 11 08:58:34.473558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 556/1133] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:58:34 2022] DELETE /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:34.478910 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:34.479528 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: ff049257-22d8-414c-9ad2-c5e2c33470b9] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:34.485607 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:34.486096 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:34.486556 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:34.487246 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:34.487958 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:34.488379 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:34.502264 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 HTTP/1.1 Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:58:34.503840 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:58:34.505757 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'ff049257-22d8-414c-9ad2-c5e2c33470b9'} Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:34.506765 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. Sep 11 08:58:34.508270 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:34.510375 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance ff049257-22d8-414c-9ad2-c5e2c33470b9 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:34.510375 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3957bd4f-1ddf-4c71-94d7-eac2872f8e9e tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9" status: 404 len: 111 microversion: 2.1 time: 0.030260 Sep 11 08:58:34.510375 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 578/1134] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:58:34 2022] GET /compute/v2.1/servers/ff049257-22d8-414c-9ad2-c5e2c33470b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:35.794404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:35.794979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:35.801877 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:35.802475 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:35.802903 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:35.803608 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:35.804054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:35.804466 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:35.819113 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: DELETE /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 HTTP/1.1 Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:58:35.820703 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:58:35.822932 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'be5fbae7-a31c-412a-997f-365bb68b7ea6'} Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:35.823865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:58:35.825336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:35.826885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:35.826885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-56ae2251-0959-4414-b465-fdddbbc738ca tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "DELETE /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 404 len: 111 microversion: 2.1 time: 0.032449 Sep 11 08:58:35.826885 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 557/1135] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:58:35 2022] DELETE /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:35.832597 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:35.833271 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] [instance: be5fbae7-a31c-412a-997f-365bb68b7ea6] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:35.840435 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:35.840907 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:35.841333 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:35.842018 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:35.842521 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:35.842944 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:35.856701 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] HTTP exception thrown: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Request method failure captured: Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 HTTP/1.1 Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaII1Mqc95zCvf4gThHS-iu4pTaxZpWaw2m2Qe2ZFa6HiTUCxvmRgJEfETnnbGb6qBhdfg01vxqRwN8jCNvXjs4AYvHsypzkO-rQKGGGlJRZhj7lUfhvuSgR5YPJ2F0cGJwSNb4OXvGXSRL3QCc-MUSXU2u5GslIwUYrnHQQ7wa562Y Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:58:35.858269 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c0401850bdf44aaaa6c37ed752708f53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c0401850bdf44aaaa6c37ed752708f53", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: c0401850bdf44aaaa6c37ed752708f53 Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2137209792 Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: c1c1de0489104713a90c59b89a284321 Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-AttachVolumeNegativeTest-2137209792-project Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:58:35.859980 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'be5fbae7-a31c-412a-997f-365bb68b7ea6'} Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:35.860826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. Sep 11 08:58:35.862665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:35.864171 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] Returning 404 to user: Instance be5fbae7-a31c-412a-997f-365bb68b7ea6 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:35.864171 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0e4b469b-9901-4288-ade1-fd833633c9dd tempest-AttachVolumeNegativeTest-2137209792 tempest-AttachVolumeNegativeTest-2137209792-project] 10.222.0.44 "GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6" status: 404 len: 111 microversion: 2.1 time: 0.031138 Sep 11 08:58:35.864171 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 579/1136] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:58:35 2022] GET /compute/v2.1/servers/be5fbae7-a31c-412a-997f-365bb68b7ea6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:41.664576 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-45ceafae-d646-45d9-831d-45e2fb61d010 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Action: 'create', calling method: .version_select at 0x7fb27f002af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1298528941"}} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:58:42.354577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-45ceafae-d646-45d9-831d-45e2fb61d010 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.806576 Sep 11 08:58:42.354577 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 558/1137] 10.222.0.44 () {60 vars in 1155 bytes} [Sun Sep 11 08:58:41 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 808 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 11 08:58:42.367321 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-250368df-7e82-435a-a37b-95f4aff7e00b tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27ea6a3a0>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:42.416845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-250368df-7e82-435a-a37b-95f4aff7e00b tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200" status: 200 len: 345 microversion: 2.1 time: 0.053125 Sep 11 08:58:42.419663 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 580/1138] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:58:42 2022] GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:43.432408 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ab61354a-a47c-416c-9895-048f60e2cfeb tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27f158a60>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:43.481220 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ab61354a-a47c-416c-9895-048f60e2cfeb tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200" status: 200 len: 346 microversion: 2.1 time: 0.053697 Sep 11 08:58:43.481891 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 559/1139] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:58:43 2022] GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:43.496773 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3bbe486b-4cd1-492e-b705-971be2210081 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Action: 'create', calling method: .version_select at 0x7fb27ea48160>, body: {"snapshot": {"volume_id": "e1c53a6c-c08a-4907-9633-e2ee4df2c200", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-212490776"}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:58:44.041601 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3bbe486b-4cd1-492e-b705-971be2210081 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.549632 Sep 11 08:58:44.042192 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 581/1140] 10.222.0.44 () {60 vars in 1162 bytes} [Sun Sep 11 08:58:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:44.053104 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-87f69c29-19da-4dde-98c0-e74eeb43c8bf tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27f26c8b0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:44.082446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-87f69c29-19da-4dde-98c0-e74eeb43c8bf tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7" status: 200 len: 286 microversion: 2.1 time: 0.033184 Sep 11 08:58:44.083007 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 560/1141] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 08:58:44 2022] GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:44.094580 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2c1e7dea-b699-4769-b03c-5cfe7e8a0f15 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27ecf2a60>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:44.128698 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2c1e7dea-b699-4769-b03c-5cfe7e8a0f15 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037803 Sep 11 08:58:44.129271 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 582/1142] 10.222.0.44 () {58 vars in 1140 bytes} [Sun Sep 11 08:58:44 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 08:58:44.141199 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a4b33c70-c594-4d3b-aa2e-ff659949285e tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27f002af0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:44.172068 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a4b33c70-c594-4d3b-aa2e-ff659949285e tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7" status: 200 len: 286 microversion: 2.1 time: 0.034681 Sep 11 08:58:44.172633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 561/1143] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 08:58:44 2022] GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:45.184695 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-eb0dd12b-a3fc-43d5-8594-7b3697791856 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27ea484c0>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:45.215508 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-eb0dd12b-a3fc-43d5-8594-7b3697791856 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7" status: 200 len: 286 microversion: 2.1 time: 0.035169 Sep 11 08:58:45.216079 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 583/1144] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 08:58:45 2022] GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:46.226337 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:46.227036 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:46.233130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6ca90a6d-b7f4-4c16-a3ce-6e4b5aa6a6ec tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27ed6b9d0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:46.268433 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6ca90a6d-b7f4-4c16-a3ce-6e4b5aa6a6ec tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7" status: 200 len: 286 microversion: 2.1 time: 0.043699 Sep 11 08:58:46.269025 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 562/1145] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 08:58:46 2022] GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:47.280164 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:47.281456 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:58:47.286877 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5b364735-8cff-457e-ae6b-27b96b891508 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27eae7d30>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:47.319832 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5b364735-8cff-457e-ae6b-27b96b891508 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7" status: 200 len: 287 microversion: 2.1 time: 0.040532 Sep 11 08:58:47.319832 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 584/1146] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 08:58:47 2022] GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:47.332412 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1b2fa14b-35b8-4cf5-962b-32b710387ba8 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27eba98b0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:47.428481 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1b2fa14b-35b8-4cf5-962b-32b710387ba8 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7" status: 202 len: 0 microversion: 2.1 time: 0.101546 Sep 11 08:58:47.429058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 563/1147] 10.222.0.44 () {58 vars in 1254 bytes} [Sun Sep 11 08:58:47 2022] DELETE /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:58:47.437799 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-725ec7ca-425c-4b01-ac39-0cb9c2ed57b2 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27ea48a60>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:47.473589 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-725ec7ca-425c-4b01-ac39-0cb9c2ed57b2 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7" status: 200 len: 286 microversion: 2.1 time: 0.039970 Sep 11 08:58:47.474172 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 585/1148] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 08:58:47 2022] GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:48.488530 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-66af9477-728b-4045-ab1d-0f318b5c1c06 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27edf8a60>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:48.521985 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-66af9477-728b-4045-ab1d-0f318b5c1c06 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] HTTP exception thrown: Snapshot e1038bb7-adeb-4228-8b67-8b14a4dd2da7 could not be found. Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-66af9477-728b-4045-ab1d-0f318b5c1c06 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Request method failure captured: Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7 HTTP/1.1 Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaNBbrEy4D38bJLxJju76h8exbWgGP2FW6nQVpLLLEluO5QnNDcPLcEPbDxwhSQXJoJj4wayNMOzh7YCcWKQro-DKq8qu7WsjtJtP-FdKtbVG6Kdj91cFR4KzwnYMn_5hnlR33i75RVmQqPoeRQSdEcAfdgpro5Ie9jbMtGn85ymZ54 Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: d21bd23c547f40fb816261885a0f642c Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:58:48.531514 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d21bd23c547f40fb816261885a0f642c", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: d21bd23c547f40fb816261885a0f642c Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-VolumesSnapshotsTestJSON-1660941879-project Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: d62895326fbd44448a27b5981b77b126 Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1660941879-project Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Snapshot e1038bb7-adeb-4228-8b67-8b14a4dd2da7 could not be found. Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'e1038bb7-adeb-4228-8b67-8b14a4dd2da7'} Sep 11 08:58:48.533232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e1038bb7-adeb-4228-8b67-8b14a4dd2da7 could not be found. (HTTP 404) (Request-ID: req-95edd8c2-e7ff-44d3-be84-fc811bcd283e) Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:48.534216 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 08:58:48.535604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e1038bb7-adeb-4228-8b67-8b14a4dd2da7 could not be found. Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 11 08:58:48.537865 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e1038bb7-adeb-4228-8b67-8b14a4dd2da7 could not be found. Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e1038bb7-adeb-4228-8b67-8b14a4dd2da7 could not be found. Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-66af9477-728b-4045-ab1d-0f318b5c1c06 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Returning 404 to user: Snapshot e1038bb7-adeb-4228-8b67-8b14a4dd2da7 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:48.540073 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-66af9477-728b-4045-ab1d-0f318b5c1c06 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7" status: 404 len: 111 microversion: 2.1 time: 0.049533 Sep 11 08:58:48.541174 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 564/1149] 10.222.0.44 () {58 vars in 1251 bytes} [Sun Sep 11 08:58:48 2022] GET /compute/v2.1/os-snapshots/e1038bb7-adeb-4228-8b67-8b14a4dd2da7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:48.543629 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b208e642-31eb-4e1d-9897-41a80b718f51 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27ef01550>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:48.736658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b208e642-31eb-4e1d-9897-41a80b718f51 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200" status: 202 len: 0 microversion: 2.1 time: 0.198305 Sep 11 08:58:48.737287 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 586/1150] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 08:58:48 2022] DELETE /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 11 08:58:48.747434 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e5d72ddd-d56d-40b7-b1ee-b18902c10f0c tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27edf83a0>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:48.795979 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e5d72ddd-d56d-40b7-b1ee-b18902c10f0c tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200" status: 200 len: 345 microversion: 2.1 time: 0.054013 Sep 11 08:58:48.796631 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 565/1151] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:58:48 2022] GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:58:49.811305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1d15bcf4-f45c-4c96-8a15-dc61fe67afe5 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27e9f5c10>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:49.840168 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-1d15bcf4-f45c-4c96-8a15-dc61fe67afe5 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] HTTP exception thrown: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1d15bcf4-f45c-4c96-8a15-dc61fe67afe5 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Request method failure captured: Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200 HTTP/1.1 Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaNBbrEy4D38bJLxJju76h8exbWgGP2FW6nQVpLLLEluO5QnNDcPLcEPbDxwhSQXJoJj4wayNMOzh7YCcWKQro-DKq8qu7WsjtJtP-FdKtbVG6Kdj91cFR4KzwnYMn_5hnlR33i75RVmQqPoeRQSdEcAfdgpro5Ie9jbMtGn85ymZ54 Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: d21bd23c547f40fb816261885a0f642c Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:58:49.844844 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d21bd23c547f40fb816261885a0f642c", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: d21bd23c547f40fb816261885a0f642c Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-VolumesSnapshotsTestJSON-1660941879-project Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: d62895326fbd44448a27b5981b77b126 Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1660941879-project Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'e1c53a6c-c08a-4907-9633-e2ee4df2c200'} Sep 11 08:58:49.846599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. (HTTP 404) (Request-ID: req-28ce59a3-4ebe-4e8d-93d9-19e363ab515a) Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:49.847598 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 08:58:49.848826 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 08:58:49.850035 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1d15bcf4-f45c-4c96-8a15-dc61fe67afe5 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Returning 404 to user: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1d15bcf4-f45c-4c96-8a15-dc61fe67afe5 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200" status: 404 len: 109 microversion: 2.1 time: 0.036665 Sep 11 08:58:49.851356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 587/1152] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:58:49 2022] GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:49.858781 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7177898a-1ff9-434a-8317-838a582a43be tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27f002f70>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:49.890267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-7177898a-1ff9-434a-8317-838a582a43be tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] HTTP exception thrown: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7177898a-1ff9-434a-8317-838a582a43be tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Request method failure captured: Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: DELETE /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200 HTTP/1.1 Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaNBbrEy4D38bJLxJju76h8exbWgGP2FW6nQVpLLLEluO5QnNDcPLcEPbDxwhSQXJoJj4wayNMOzh7YCcWKQro-DKq8qu7WsjtJtP-FdKtbVG6Kdj91cFR4KzwnYMn_5hnlR33i75RVmQqPoeRQSdEcAfdgpro5Ie9jbMtGn85ymZ54 Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: d21bd23c547f40fb816261885a0f642c Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:58:49.892546 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d21bd23c547f40fb816261885a0f642c", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: d21bd23c547f40fb816261885a0f642c Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-VolumesSnapshotsTestJSON-1660941879-project Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: d62895326fbd44448a27b5981b77b126 Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1660941879-project Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'e1c53a6c-c08a-4907-9633-e2ee4df2c200'} Sep 11 08:58:49.894251 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. (HTTP 404) (Request-ID: req-3d0cc3dd-b0d5-46d6-94a4-ca51557f9df2) Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:49.895267 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 11 08:58:49.896724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 11 08:58:49.898279 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-7177898a-1ff9-434a-8317-838a582a43be tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Returning 404 to user: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:49.900266 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-7177898a-1ff9-434a-8317-838a582a43be tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200" status: 404 len: 109 microversion: 2.1 time: 0.039579 Sep 11 08:58:49.901290 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 566/1153] 10.222.0.44 () {58 vars in 1248 bytes} [Sun Sep 11 08:58:49 2022] DELETE /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:58:49.903094 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a17e0d91-5341-491e-adc3-9e2fa597ccc0 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Calling method '.version_select at 0x7fb27ebdcca0>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:49.932009 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-a17e0d91-5341-491e-adc3-9e2fa597ccc0 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] HTTP exception thrown: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a17e0d91-5341-491e-adc3-9e2fa597ccc0 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Request method failure captured: Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200 HTTP/1.1 Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaNBbrEy4D38bJLxJju76h8exbWgGP2FW6nQVpLLLEluO5QnNDcPLcEPbDxwhSQXJoJj4wayNMOzh7YCcWKQro-DKq8qu7WsjtJtP-FdKtbVG6Kdj91cFR4KzwnYMn_5hnlR33i75RVmQqPoeRQSdEcAfdgpro5Ie9jbMtGn85ymZ54 Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: d21bd23c547f40fb816261885a0f642c Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 08:58:49.933942 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d21bd23c547f40fb816261885a0f642c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d21bd23c547f40fb816261885a0f642c", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: d21bd23c547f40fb816261885a0f642c Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1660941879 Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-VolumesSnapshotsTestJSON-1660941879-project Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: d62895326fbd44448a27b5981b77b126 Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1660941879-project Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'e1c53a6c-c08a-4907-9633-e2ee4df2c200'} Sep 11 08:58:49.935644 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. (HTTP 404) (Request-ID: req-31416ffb-597e-4143-bc2b-e974e8a72bb3) Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:49.936755 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 11 08:58:49.938224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 11 08:58:49.939954 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-a17e0d91-5341-491e-adc3-9e2fa597ccc0 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] Returning 404 to user: Volume e1c53a6c-c08a-4907-9633-e2ee4df2c200 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-a17e0d91-5341-491e-adc3-9e2fa597ccc0 tempest-VolumesSnapshotsTestJSON-1660941879 tempest-VolumesSnapshotsTestJSON-1660941879-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200" status: 404 len: 109 microversion: 2.1 time: 0.036717 Sep 11 08:58:49.941494 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 588/1154] 10.222.0.44 () {58 vars in 1245 bytes} [Sun Sep 11 08:58:49 2022] GET /compute/v2.1/os-volumes/e1c53a6c-c08a-4907-9633-e2ee4df2c200 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 08:58:58.357138 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 08:58:58.357740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Sun Sep 11 08:58:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 (ip 10.222.0.44) !!! Sep 11 08:58:58.367702 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-70407b0f-6eaf-4399-a07d-33d9f4c585e1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:58.368461 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-70407b0f-6eaf-4399-a07d-33d9f4c585e1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:58.379545 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70407b0f-6eaf-4399-a07d-33d9f4c585e1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:58.380032 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70407b0f-6eaf-4399-a07d-33d9f4c585e1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:58.380464 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70407b0f-6eaf-4399-a07d-33d9f4c585e1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:58.381170 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70407b0f-6eaf-4399-a07d-33d9f4c585e1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:58.381621 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70407b0f-6eaf-4399-a07d-33d9f4c585e1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:58.382045 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-70407b0f-6eaf-4399-a07d-33d9f4c585e1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:58.408157 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-70407b0f-6eaf-4399-a07d-33d9f4c585e1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 08:58:58.690734 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-70407b0f-6eaf-4399-a07d-33d9f4c585e1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 204 len: 0 microversion: 2.1 time: 0.335595 Sep 11 08:58:58.691325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 567/1155] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 08:58:58 2022] DELETE /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 08:58:58.705567 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5b0522ad-2a39-4047-84c4-d96157639bd1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:58.706224 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5b0522ad-2a39-4047-84c4-d96157639bd1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:58.713261 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5b0522ad-2a39-4047-84c4-d96157639bd1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:58.713758 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5b0522ad-2a39-4047-84c4-d96157639bd1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:58.714276 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5b0522ad-2a39-4047-84c4-d96157639bd1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:58.715000 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5b0522ad-2a39-4047-84c4-d96157639bd1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:58.715475 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5b0522ad-2a39-4047-84c4-d96157639bd1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:58.715888 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5b0522ad-2a39-4047-84c4-d96157639bd1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:58.858527 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5b0522ad-2a39-4047-84c4-d96157639bd1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:58:58.867945 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5b0522ad-2a39-4047-84c4-d96157639bd1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1577 microversion: 2.1 time: 0.168037 Sep 11 08:58:58.868540 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 589/1156] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:58:58 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:58:59.892485 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-551216a4-7ef4-4d68-888f-98e5c3bef138 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:58:59.893260 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-551216a4-7ef4-4d68-888f-98e5c3bef138 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:58:59.900091 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-551216a4-7ef4-4d68-888f-98e5c3bef138 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:59.900592 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-551216a4-7ef4-4d68-888f-98e5c3bef138 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:59.901035 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-551216a4-7ef4-4d68-888f-98e5c3bef138 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:58:59.901765 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-551216a4-7ef4-4d68-888f-98e5c3bef138 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:58:59.902259 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-551216a4-7ef4-4d68-888f-98e5c3bef138 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:58:59.902688 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-551216a4-7ef4-4d68-888f-98e5c3bef138 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:00.054245 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-551216a4-7ef4-4d68-888f-98e5c3bef138 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:00.062887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-551216a4-7ef4-4d68-888f-98e5c3bef138 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1577 microversion: 2.1 time: 0.174785 Sep 11 08:59:00.063470 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 568/1157] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:58:59 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:01.087648 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-277d93ce-04a8-4a83-a86d-e545d5cc5bad tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:01.088360 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-277d93ce-04a8-4a83-a86d-e545d5cc5bad tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:01.096141 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-277d93ce-04a8-4a83-a86d-e545d5cc5bad tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:01.096628 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-277d93ce-04a8-4a83-a86d-e545d5cc5bad tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:01.097066 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-277d93ce-04a8-4a83-a86d-e545d5cc5bad tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:01.097771 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-277d93ce-04a8-4a83-a86d-e545d5cc5bad tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:01.098241 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-277d93ce-04a8-4a83-a86d-e545d5cc5bad tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:01.098672 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-277d93ce-04a8-4a83-a86d-e545d5cc5bad tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:01.361479 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-277d93ce-04a8-4a83-a86d-e545d5cc5bad tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:01.370795 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-277d93ce-04a8-4a83-a86d-e545d5cc5bad tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1577 microversion: 2.1 time: 0.287180 Sep 11 08:59:01.371599 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 590/1158] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:01 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1577 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:01.563309 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-9bb5b782-791e-4851-8be7-763935640fee req-f53736fc-77de-4461-a283-8bcb1de34ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d102028f-9e13-426e-ae8e-dfc13f6ea147", "name": "network-vif-deleted", "tag": "3f4adc04-6422-427d-b39e-78573123bcc9"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:59:01.567679 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-9bb5b782-791e-4851-8be7-763935640fee req-f53736fc-77de-4461-a283-8bcb1de34ed2 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:01.568258 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-9bb5b782-791e-4851-8be7-763935640fee req-f53736fc-77de-4461-a283-8bcb1de34ed2 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:01.568754 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-9bb5b782-791e-4851-8be7-763935640fee req-f53736fc-77de-4461-a283-8bcb1de34ed2 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:01.581029 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-9bb5b782-791e-4851-8be7-763935640fee req-f53736fc-77de-4461-a283-8bcb1de34ed2 service nova] Creating event network-vif-deleted:3f4adc04-6422-427d-b39e-78573123bcc9 for instance d102028f-9e13-426e-ae8e-dfc13f6ea147 on hv-cinder-85694 Sep 11 08:59:01.587758 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-9bb5b782-791e-4851-8be7-763935640fee req-f53736fc-77de-4461-a283-8bcb1de34ed2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034856 Sep 11 08:59:01.589565 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 569/1159] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:59:02.394973 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:02.396929 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:02.408979 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:02.409675 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:02.410277 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:02.411292 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:02.411774 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:02.412238 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:02.449972 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:02.450559 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:02.451392 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:02.452271 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lazy-loading 'fault' on Instance uuid d102028f-9e13-426e-ae8e-dfc13f6ea147 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 08:59:02.503381 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:02.512055 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-08a38193-4404-4206-a26a-0d11d8900cf5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 200 len: 1230 microversion: 2.1 time: 0.121244 Sep 11 08:59:02.512627 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 591/1160] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:02 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 1230 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:03.537319 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:03.538059 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:03.544882 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:03.549995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:03.549995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:03.549995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:03.549995 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:03.550416 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:03.561186 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] HTTP exception thrown: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Request method failure captured: Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 HTTP/1.1 Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaKclZkxep2bvXUZ3mXjjayTCi4aM7DS5TUnDAJzwpjdmNBfR7lhFNF4tfu8iaLW3X0NwFw-CKCMqMmoh248yGgDvC8jjJT03GGzogRSpZV0yLHBmJMcTxoxuhn9llEHGWYekCaEIrYnV4UE0kFAe7mLCy1Mz3HMofiY-st1aOtf7dQ Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 6d5504106ccb4549b09f29d7104d9b0a Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-TestVolumeBootPattern-830871099 Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 08:59:03.562956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6d5504106ccb4549b09f29d7104d9b0a", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-TestVolumeBootPattern-830871099 Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 6d5504106ccb4549b09f29d7104d9b0a Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-TestVolumeBootPattern-830871099 Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-TestVolumeBootPattern-830871099-project Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: ed50f5d8261d44b487390de092ef9136 Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-TestVolumeBootPattern-830871099-project Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 08:59:03.564744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'd102028f-9e13-426e-ae8e-dfc13f6ea147'} Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 08:59:03.565768 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 08:59:03.567452 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 08:59:03.569009 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Returning 404 to user: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 08:59:03.569009 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e97d0435-7248-4997-a69e-408596595ea9 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 404 len: 111 microversion: 2.1 time: 0.031398 Sep 11 08:59:03.571326 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 570/1161] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:03 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 08:59:03.668925 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1952982980", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-425546129", "security_groups": [{"name": "tempest-secgroup-smoke-1731546175"}], "block_device_mapping_v2": [{"uuid": "1c8149ad-7ed1-4f99-811f-ef522e75949b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e66bcb0e-f46e-44d7-8b38-5be5802adf36"}]}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:59:03.807760 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] validate_networks() for [('e66bcb0e-f46e-44d7-8b38-5be5802adf36', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 08:59:04.216547 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 08:59:04.216969 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 08:59:04.217438 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 08:59:04.217903 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 08:59:04.218339 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 08:59:04.231621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:04.231621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:04.231621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:04.231621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:04.232255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:04.232255 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:04.248498 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Getting quotas for project 6d5504106ccb4549b09f29d7104d9b0a. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 08:59:04.252491 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Getting quotas for user ed50f5d8261d44b487390de092ef9136 and project 6d5504106ccb4549b09f29d7104d9b0a. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 08:59:04.319877 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 08:59:04.322985 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c8149ad-7ed1-4f99-811f-ef522e75949b',volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 08:59:04.735642 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-81ebff4a-70ff-4370-877d-5d5e087ba868 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.070645 Sep 11 08:59:04.736370 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 592/1162] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 08:59:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 08:59:04.749219 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e0ae3879-ffb9-45d6-82c1-0380c73a7cf0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:04.749809 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e0ae3879-ffb9-45d6-82c1-0380c73a7cf0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:04.829628 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e0ae3879-ffb9-45d6-82c1-0380c73a7cf0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:04.837705 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e0ae3879-ffb9-45d6-82c1-0380c73a7cf0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1094 microversion: 2.1 time: 0.092386 Sep 11 08:59:04.838334 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 571/1163] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:04 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:05.867032 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-57442c9a-8851-4cbc-9137-97e20b895806 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:05.867654 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-57442c9a-8851-4cbc-9137-97e20b895806 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:05.880002 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-57442c9a-8851-4cbc-9137-97e20b895806 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:05.880482 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-57442c9a-8851-4cbc-9137-97e20b895806 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:05.880915 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-57442c9a-8851-4cbc-9137-97e20b895806 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:05.881671 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-57442c9a-8851-4cbc-9137-97e20b895806 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:05.882143 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-57442c9a-8851-4cbc-9137-97e20b895806 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:05.882506 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-57442c9a-8851-4cbc-9137-97e20b895806 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:05.950507 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-57442c9a-8851-4cbc-9137-97e20b895806 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:05.958089 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-57442c9a-8851-4cbc-9137-97e20b895806 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1144 microversion: 2.1 time: 0.101619 Sep 11 08:59:05.958672 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 593/1164] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:05 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1144 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:06.981233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-abd4917e-b01d-4e74-8f6c-ad1c6053c854 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:06.981824 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-abd4917e-b01d-4e74-8f6c-ad1c6053c854 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:06.989689 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abd4917e-b01d-4e74-8f6c-ad1c6053c854 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:06.990204 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abd4917e-b01d-4e74-8f6c-ad1c6053c854 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:06.990959 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abd4917e-b01d-4e74-8f6c-ad1c6053c854 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:06.991682 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abd4917e-b01d-4e74-8f6c-ad1c6053c854 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:06.992174 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abd4917e-b01d-4e74-8f6c-ad1c6053c854 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:06.992600 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-abd4917e-b01d-4e74-8f6c-ad1c6053c854 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:07.085772 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-abd4917e-b01d-4e74-8f6c-ad1c6053c854 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:07.095635 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-abd4917e-b01d-4e74-8f6c-ad1c6053c854 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1192 microversion: 2.1 time: 0.118278 Sep 11 08:59:07.096210 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 572/1165] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:06 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1192 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:59:08.121316 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9a3d04ce-60a7-431b-8123-e13c1df665a0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:08.121988 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9a3d04ce-60a7-431b-8123-e13c1df665a0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:08.128533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a3d04ce-60a7-431b-8123-e13c1df665a0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:08.129030 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a3d04ce-60a7-431b-8123-e13c1df665a0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:08.129472 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a3d04ce-60a7-431b-8123-e13c1df665a0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:08.130211 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a3d04ce-60a7-431b-8123-e13c1df665a0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:08.130675 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a3d04ce-60a7-431b-8123-e13c1df665a0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:08.131108 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9a3d04ce-60a7-431b-8123-e13c1df665a0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:08.204198 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9a3d04ce-60a7-431b-8123-e13c1df665a0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:08.213068 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9a3d04ce-60a7-431b-8123-e13c1df665a0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1210 microversion: 2.1 time: 0.095136 Sep 11 08:59:08.213665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 594/1166] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:08 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:09.237306 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4f76c4c5-83ea-4bc3-893e-529f170d447b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:09.243086 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4f76c4c5-83ea-4bc3-893e-529f170d447b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:09.245824 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f76c4c5-83ea-4bc3-893e-529f170d447b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:09.246377 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f76c4c5-83ea-4bc3-893e-529f170d447b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:09.246971 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f76c4c5-83ea-4bc3-893e-529f170d447b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:09.247716 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f76c4c5-83ea-4bc3-893e-529f170d447b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:09.248175 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f76c4c5-83ea-4bc3-893e-529f170d447b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:09.248633 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-4f76c4c5-83ea-4bc3-893e-529f170d447b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:09.418393 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4f76c4c5-83ea-4bc3-893e-529f170d447b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:09.426294 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-6a6c2425-1de9-4013-ba7e-0e4419567206 req-c681e2ad-4cfa-499e-9791-3bfb5fee5445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c75c57-4b25-4562-bb8e-3475d82d8a18", "tag": "27d73c4c-bc09-4824-ae90-fa59d3d43c5f"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:59:09.434027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4f76c4c5-83ea-4bc3-893e-529f170d447b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.200404 Sep 11 08:59:09.435131 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 573/1167] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:09 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:09.450317 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-6a6c2425-1de9-4013-ba7e-0e4419567206 req-c681e2ad-4cfa-499e-9791-3bfb5fee5445 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:09.453503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-6a6c2425-1de9-4013-ba7e-0e4419567206 req-c681e2ad-4cfa-499e-9791-3bfb5fee5445 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:09.453503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-6a6c2425-1de9-4013-ba7e-0e4419567206 req-c681e2ad-4cfa-499e-9791-3bfb5fee5445 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:09.472470 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-6a6c2425-1de9-4013-ba7e-0e4419567206 req-c681e2ad-4cfa-499e-9791-3bfb5fee5445 service nova] Creating event network-changed:27d73c4c-bc09-4824-ae90-fa59d3d43c5f for instance 18c75c57-4b25-4562-bb8e-3475d82d8a18 on hv-cinder-85694 Sep 11 08:59:09.479378 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-6a6c2425-1de9-4013-ba7e-0e4419567206 req-c681e2ad-4cfa-499e-9791-3bfb5fee5445 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063165 Sep 11 08:59:09.479993 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 595/1168] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:59:10.472232 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-1db373c7-3a9d-4d3d-9773-852e6eed71f0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:10.472764 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-1db373c7-3a9d-4d3d-9773-852e6eed71f0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:10.479646 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1db373c7-3a9d-4d3d-9773-852e6eed71f0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:10.480130 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1db373c7-3a9d-4d3d-9773-852e6eed71f0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:10.480551 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1db373c7-3a9d-4d3d-9773-852e6eed71f0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:10.481233 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1db373c7-3a9d-4d3d-9773-852e6eed71f0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:10.481676 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1db373c7-3a9d-4d3d-9773-852e6eed71f0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:10.482091 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-1db373c7-3a9d-4d3d-9773-852e6eed71f0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:10.619440 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-1db373c7-3a9d-4d3d-9773-852e6eed71f0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:10.627313 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-1db373c7-3a9d-4d3d-9773-852e6eed71f0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.158944 Sep 11 08:59:10.632406 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 574/1169] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:10 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:11.652079 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-eb443c19-8f5a-4ba8-a8f4-58185a0cf180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:11.652783 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-eb443c19-8f5a-4ba8-a8f4-58185a0cf180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:11.659130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb443c19-8f5a-4ba8-a8f4-58185a0cf180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:11.659621 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb443c19-8f5a-4ba8-a8f4-58185a0cf180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:11.660058 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb443c19-8f5a-4ba8-a8f4-58185a0cf180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:11.660751 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb443c19-8f5a-4ba8-a8f4-58185a0cf180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:11.661202 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb443c19-8f5a-4ba8-a8f4-58185a0cf180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:11.661625 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-eb443c19-8f5a-4ba8-a8f4-58185a0cf180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:11.800969 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-eb443c19-8f5a-4ba8-a8f4-58185a0cf180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:11.808752 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-eb443c19-8f5a-4ba8-a8f4-58185a0cf180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.162061 Sep 11 08:59:11.809324 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 596/1170] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:11 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:12.831411 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-a99c7ede-95a7-4699-a2ea-df1245ce3180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:12.832049 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-a99c7ede-95a7-4699-a2ea-df1245ce3180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:12.838731 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a99c7ede-95a7-4699-a2ea-df1245ce3180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:12.839707 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a99c7ede-95a7-4699-a2ea-df1245ce3180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:12.840135 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a99c7ede-95a7-4699-a2ea-df1245ce3180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:12.840824 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a99c7ede-95a7-4699-a2ea-df1245ce3180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:12.841268 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a99c7ede-95a7-4699-a2ea-df1245ce3180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:12.841682 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-a99c7ede-95a7-4699-a2ea-df1245ce3180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:12.980933 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-a99c7ede-95a7-4699-a2ea-df1245ce3180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:12.990120 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-a99c7ede-95a7-4699-a2ea-df1245ce3180 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.162590 Sep 11 08:59:12.990726 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 575/1171] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:12 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:14.013896 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b94a5750-0d9c-4ed0-81b9-92d05d525cc5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:14.014615 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b94a5750-0d9c-4ed0-81b9-92d05d525cc5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:14.020834 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b94a5750-0d9c-4ed0-81b9-92d05d525cc5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:14.022679 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b94a5750-0d9c-4ed0-81b9-92d05d525cc5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:14.022679 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b94a5750-0d9c-4ed0-81b9-92d05d525cc5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:14.022679 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b94a5750-0d9c-4ed0-81b9-92d05d525cc5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:14.022943 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b94a5750-0d9c-4ed0-81b9-92d05d525cc5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:14.023288 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b94a5750-0d9c-4ed0-81b9-92d05d525cc5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:14.160691 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b94a5750-0d9c-4ed0-81b9-92d05d525cc5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:14.168676 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b94a5750-0d9c-4ed0-81b9-92d05d525cc5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.159394 Sep 11 08:59:14.171658 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 597/1172] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:14 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:15.192429 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-0baa6abb-d1e5-4762-a7f9-2643d407ab6d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:15.192991 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-0baa6abb-d1e5-4762-a7f9-2643d407ab6d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:15.195471 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:59:15.201107 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0baa6abb-d1e5-4762-a7f9-2643d407ab6d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:15.201590 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0baa6abb-d1e5-4762-a7f9-2643d407ab6d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:15.202028 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0baa6abb-d1e5-4762-a7f9-2643d407ab6d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:15.202840 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0baa6abb-d1e5-4762-a7f9-2643d407ab6d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:15.203295 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0baa6abb-d1e5-4762-a7f9-2643d407ab6d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:15.203724 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-0baa6abb-d1e5-4762-a7f9-2643d407ab6d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:15.337837 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-0baa6abb-d1e5-4762-a7f9-2643d407ab6d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:15.347532 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-0baa6abb-d1e5-4762-a7f9-2643d407ab6d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.158914 Sep 11 08:59:15.348382 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 576/1173] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:15 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:16.371290 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-1d01f611-b2c6-49d5-9b15-6623c4bbf37e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:16.373015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-1d01f611-b2c6-49d5-9b15-6623c4bbf37e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:16.376797 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:59:16.377725 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=6 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:59:16.381929 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d01f611-b2c6-49d5-9b15-6623c4bbf37e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:16.382455 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d01f611-b2c6-49d5-9b15-6623c4bbf37e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:16.382893 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d01f611-b2c6-49d5-9b15-6623c4bbf37e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:16.383595 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d01f611-b2c6-49d5-9b15-6623c4bbf37e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:16.384141 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d01f611-b2c6-49d5-9b15-6623c4bbf37e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:16.384638 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-1d01f611-b2c6-49d5-9b15-6623c4bbf37e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:16.525205 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-1d01f611-b2c6-49d5-9b15-6623c4bbf37e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:16.533709 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-1d01f611-b2c6-49d5-9b15-6623c4bbf37e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.166317 Sep 11 08:59:16.534395 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 598/1174] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:16 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:17.557378 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-aa03eef6-1380-4aea-aa22-0588740e26f5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:17.557988 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-aa03eef6-1380-4aea-aa22-0588740e26f5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:17.564404 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa03eef6-1380-4aea-aa22-0588740e26f5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:17.564887 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa03eef6-1380-4aea-aa22-0588740e26f5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:17.565319 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa03eef6-1380-4aea-aa22-0588740e26f5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:17.566010 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa03eef6-1380-4aea-aa22-0588740e26f5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:17.566485 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa03eef6-1380-4aea-aa22-0588740e26f5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:17.566905 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-aa03eef6-1380-4aea-aa22-0588740e26f5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:17.696798 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-aa03eef6-1380-4aea-aa22-0588740e26f5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:17.705215 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-aa03eef6-1380-4aea-aa22-0588740e26f5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.151817 Sep 11 08:59:17.705774 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 577/1175] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:17 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:18.727791 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0825501d-1d82-4b56-b275-4042ac883fd5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:18.728440 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0825501d-1d82-4b56-b275-4042ac883fd5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:18.735540 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0825501d-1d82-4b56-b275-4042ac883fd5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:18.736026 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0825501d-1d82-4b56-b275-4042ac883fd5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:18.736463 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0825501d-1d82-4b56-b275-4042ac883fd5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:18.737154 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0825501d-1d82-4b56-b275-4042ac883fd5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:18.737614 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0825501d-1d82-4b56-b275-4042ac883fd5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:18.738321 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0825501d-1d82-4b56-b275-4042ac883fd5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:18.884273 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0825501d-1d82-4b56-b275-4042ac883fd5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:18.892535 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0825501d-1d82-4b56-b275-4042ac883fd5 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.168845 Sep 11 08:59:18.893098 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 599/1176] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:18 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:19.915787 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ce402db5-2283-46c3-8dd1-4d4c9e9caa3b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:19.916493 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ce402db5-2283-46c3-8dd1-4d4c9e9caa3b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:19.923653 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce402db5-2283-46c3-8dd1-4d4c9e9caa3b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:19.925842 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce402db5-2283-46c3-8dd1-4d4c9e9caa3b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:19.925842 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce402db5-2283-46c3-8dd1-4d4c9e9caa3b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:19.925842 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce402db5-2283-46c3-8dd1-4d4c9e9caa3b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:19.925842 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce402db5-2283-46c3-8dd1-4d4c9e9caa3b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:19.926235 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ce402db5-2283-46c3-8dd1-4d4c9e9caa3b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:19.928719 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 08:59:20.061763 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-ce402db5-2283-46c3-8dd1-4d4c9e9caa3b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:20.070223 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ce402db5-2283-46c3-8dd1-4d4c9e9caa3b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.158282 Sep 11 08:59:20.070801 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 578/1177] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:19 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 08:59:20.874533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-e61b4ca9-7619-4919-8620-37dd1d4ed8a9 req-0ac5688c-e216-4de5-bbc0-2f7a19cf440a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c75c57-4b25-4562-bb8e-3475d82d8a18", "name": "network-vif-plugged", "status": "completed", "tag": "27d73c4c-bc09-4824-ae90-fa59d3d43c5f"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:59:20.881726 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-e61b4ca9-7619-4919-8620-37dd1d4ed8a9 req-0ac5688c-e216-4de5-bbc0-2f7a19cf440a service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:20.882235 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-e61b4ca9-7619-4919-8620-37dd1d4ed8a9 req-0ac5688c-e216-4de5-bbc0-2f7a19cf440a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:20.882665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-e61b4ca9-7619-4919-8620-37dd1d4ed8a9 req-0ac5688c-e216-4de5-bbc0-2f7a19cf440a service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:20.896021 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-e61b4ca9-7619-4919-8620-37dd1d4ed8a9 req-0ac5688c-e216-4de5-bbc0-2f7a19cf440a service nova] Creating event network-vif-plugged:27d73c4c-bc09-4824-ae90-fa59d3d43c5f for instance 18c75c57-4b25-4562-bb8e-3475d82d8a18 on hv-cinder-85694 Sep 11 08:59:20.901819 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-e61b4ca9-7619-4919-8620-37dd1d4ed8a9 req-0ac5688c-e216-4de5-bbc0-2f7a19cf440a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168303 Sep 11 08:59:20.902560 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 600/1178] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 08:59:21.096067 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d164c1cf-b133-4c44-9266-c93585e7f05f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:21.096067 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d164c1cf-b133-4c44-9266-c93585e7f05f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:21.100481 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d164c1cf-b133-4c44-9266-c93585e7f05f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:21.100966 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d164c1cf-b133-4c44-9266-c93585e7f05f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:21.101394 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d164c1cf-b133-4c44-9266-c93585e7f05f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:21.102092 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d164c1cf-b133-4c44-9266-c93585e7f05f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:21.102587 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d164c1cf-b133-4c44-9266-c93585e7f05f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:21.103011 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d164c1cf-b133-4c44-9266-c93585e7f05f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:21.241137 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d164c1cf-b133-4c44-9266-c93585e7f05f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:21.252027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d164c1cf-b133-4c44-9266-c93585e7f05f tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.162880 Sep 11 08:59:21.253187 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 579/1179] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:21 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:22.276732 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-3e8b2b57-5fb5-41e4-866f-03b33de22cc1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:22.277550 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-3e8b2b57-5fb5-41e4-866f-03b33de22cc1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:22.284517 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e8b2b57-5fb5-41e4-866f-03b33de22cc1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:22.285014 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e8b2b57-5fb5-41e4-866f-03b33de22cc1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:22.285711 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e8b2b57-5fb5-41e4-866f-03b33de22cc1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:22.287571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e8b2b57-5fb5-41e4-866f-03b33de22cc1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:22.287571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e8b2b57-5fb5-41e4-866f-03b33de22cc1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:22.287571 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-3e8b2b57-5fb5-41e4-866f-03b33de22cc1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:22.428469 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-3e8b2b57-5fb5-41e4-866f-03b33de22cc1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:22.438338 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-3e8b2b57-5fb5-41e4-866f-03b33de22cc1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1266 microversion: 2.1 time: 0.166824 Sep 11 08:59:22.439253 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 601/1180] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:22 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:23.469621 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-d9bd0eb0-be18-48c4-a42e-ea600a42768c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:23.470363 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-d9bd0eb0-be18-48c4-a42e-ea600a42768c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:23.476994 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9bd0eb0-be18-48c4-a42e-ea600a42768c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:23.477480 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9bd0eb0-be18-48c4-a42e-ea600a42768c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:23.477915 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9bd0eb0-be18-48c4-a42e-ea600a42768c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:23.478645 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9bd0eb0-be18-48c4-a42e-ea600a42768c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:23.479094 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9bd0eb0-be18-48c4-a42e-ea600a42768c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:23.479519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-d9bd0eb0-be18-48c4-a42e-ea600a42768c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:23.613767 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-d9bd0eb0-be18-48c4-a42e-ea600a42768c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:23.621629 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-d9bd0eb0-be18-48c4-a42e-ea600a42768c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1453 microversion: 2.1 time: 0.156479 Sep 11 08:59:23.622237 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 580/1181] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:23 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:23.643999 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-0b6f073a-be48-4f20-adcf-4cfe260be355 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 08:59:23.644611 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-0b6f073a-be48-4f20-adcf-4cfe260be355 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 08:59:23.650983 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6f073a-be48-4f20-adcf-4cfe260be355 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:23.651404 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6f073a-be48-4f20-adcf-4cfe260be355 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:23.651845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6f073a-be48-4f20-adcf-4cfe260be355 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:23.653145 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6f073a-be48-4f20-adcf-4cfe260be355 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:23.653600 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6f073a-be48-4f20-adcf-4cfe260be355 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:23.654024 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-0b6f073a-be48-4f20-adcf-4cfe260be355 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:23.784869 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-0b6f073a-be48-4f20-adcf-4cfe260be355 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 08:59:23.792592 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-0b6f073a-be48-4f20-adcf-4cfe260be355 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1453 microversion: 2.1 time: 0.152394 Sep 11 08:59:23.793176 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 602/1182] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 08:59:23 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 08:59:26.050191 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-8e22f518-d217-43d1-879f-5ceade60e6e7 req-8968861d-c907-45aa-ad5f-c0db64ac1884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c75c57-4b25-4562-bb8e-3475d82d8a18", "tag": "27d73c4c-bc09-4824-ae90-fa59d3d43c5f"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 08:59:26.069246 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-8e22f518-d217-43d1-879f-5ceade60e6e7 req-8968861d-c907-45aa-ad5f-c0db64ac1884 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 08:59:26.072403 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-8e22f518-d217-43d1-879f-5ceade60e6e7 req-8968861d-c907-45aa-ad5f-c0db64ac1884 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 08:59:26.072403 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-8e22f518-d217-43d1-879f-5ceade60e6e7 req-8968861d-c907-45aa-ad5f-c0db64ac1884 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 08:59:26.084532 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-8e22f518-d217-43d1-879f-5ceade60e6e7 req-8968861d-c907-45aa-ad5f-c0db64ac1884 service nova] Creating event network-changed:27d73c4c-bc09-4824-ae90-fa59d3d43c5f for instance 18c75c57-4b25-4562-bb8e-3475d82d8a18 on hv-cinder-85694 Sep 11 08:59:26.091160 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-8e22f518-d217-43d1-879f-5ceade60e6e7 req-8968861d-c907-45aa-ad5f-c0db64ac1884 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119476 Sep 11 08:59:26.092168 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 581/1183] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 08:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 09:01:04.864627 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:01:04.865432 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=74 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:01:04.866764 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 11 09:01:04.873432 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1767695891", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-425546129", "security_groups": [{"name": "tempest-secgroup-smoke-1731546175"}], "block_device_mapping_v2": [{"uuid": "ad59b154-ef87-4d09-bd4c-6959ea4f822a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e66bcb0e-f46e-44d7-8b38-5be5802adf36"}]}} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 09:01:04.991885 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.network.neutron [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] validate_networks() for [('e66bcb0e-f46e-44d7-8b38-5be5802adf36', None, None, None, None, None)] {{(pid=127646) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 11 09:01:05.363347 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Flavor limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 11 09:01:05.363768 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Image limits 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 11 09:01:05.364506 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Flavor pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 11 09:01:05.364912 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Image pref 0:0:0 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 11 09:01:05.365319 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.virt.hardware [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 11 09:01:05.373940 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:05.374455 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:05.374892 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:05.375617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:05.376073 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:05.376649 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:05.393551 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Getting quotas for project 6d5504106ccb4549b09f29d7104d9b0a. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 11 09:01:05.397493 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.quota [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Getting quotas for user ed50f5d8261d44b487390de092ef9136 and project 6d5504106ccb4549b09f29d7104d9b0a. Resources: {'cores', 'instances', 'ram'} {{(pid=127646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 11 09:01:05.454126 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Going to run 1 instances... {{(pid=127646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 11 09:01:05.456939 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ad59b154-ef87-4d09-bd4c-6959ea4f822a',volume_size=None,volume_type=None)] {{(pid=127646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 11 09:01:05.907170 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-25dca4ce-26f4-4789-a21a-ef5c8290289d tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.044713 Sep 11 09:01:05.907865 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 603/1184] 10.222.0.44 () {60 vars in 1147 bytes} [Sun Sep 11 09:01:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 11 09:01:05.917497 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:01:05.925930 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=19 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:01:05.925930 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 09:01:05.925930 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Sun Sep 11 09:01:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 (ip 10.222.0.44) !!! Sep 11 09:01:05.927755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-4c77bf91-b4bf-411b-a961-5cc96d89eb87 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:05.928453 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-4c77bf91-b4bf-411b-a961-5cc96d89eb87 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:05.986677 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-4c77bf91-b4bf-411b-a961-5cc96d89eb87 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:05.993810 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-4c77bf91-b4bf-411b-a961-5cc96d89eb87 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1094 microversion: 2.1 time: 0.078367 Sep 11 09:01:05.994316 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 582/1185] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:05 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 09:01:07.016725 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fa685e03-4340-4b3b-a0a6-d19ef4200948 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:07.017948 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-fa685e03-4340-4b3b-a0a6-d19ef4200948 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:07.025457 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa685e03-4340-4b3b-a0a6-d19ef4200948 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:07.025978 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa685e03-4340-4b3b-a0a6-d19ef4200948 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:07.026463 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa685e03-4340-4b3b-a0a6-d19ef4200948 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:07.027226 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa685e03-4340-4b3b-a0a6-d19ef4200948 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:07.027701 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa685e03-4340-4b3b-a0a6-d19ef4200948 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:07.028128 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa685e03-4340-4b3b-a0a6-d19ef4200948 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:07.101631 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fa685e03-4340-4b3b-a0a6-d19ef4200948 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:07.112340 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-fa685e03-4340-4b3b-a0a6-d19ef4200948 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1144 microversion: 2.1 time: 0.098736 Sep 11 09:01:07.112921 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 604/1186] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:07 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1144 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 09:01:08.141388 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5240f5fc-24d7-46d9-9dc0-9677f3ef6649 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:08.145718 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5240f5fc-24d7-46d9-9dc0-9677f3ef6649 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:08.150655 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5240f5fc-24d7-46d9-9dc0-9677f3ef6649 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:08.151153 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5240f5fc-24d7-46d9-9dc0-9677f3ef6649 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:08.151594 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5240f5fc-24d7-46d9-9dc0-9677f3ef6649 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:08.152297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5240f5fc-24d7-46d9-9dc0-9677f3ef6649 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:08.152755 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5240f5fc-24d7-46d9-9dc0-9677f3ef6649 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:08.153182 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5240f5fc-24d7-46d9-9dc0-9677f3ef6649 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:08.218042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-5240f5fc-24d7-46d9-9dc0-9677f3ef6649 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:08.232670 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5240f5fc-24d7-46d9-9dc0-9677f3ef6649 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1200 microversion: 2.1 time: 0.095535 Sep 11 09:01:08.233268 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 583/1187] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:08 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1200 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:09.258175 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c8ac95a3-18bd-4d5b-8e4a-e4fe10997a1c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:09.258812 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c8ac95a3-18bd-4d5b-8e4a-e4fe10997a1c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:09.265235 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a3-18bd-4d5b-8e4a-e4fe10997a1c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:09.265722 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a3-18bd-4d5b-8e4a-e4fe10997a1c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:09.266550 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a3-18bd-4d5b-8e4a-e4fe10997a1c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:09.267762 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a3-18bd-4d5b-8e4a-e4fe10997a1c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:09.268163 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a3-18bd-4d5b-8e4a-e4fe10997a1c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:09.268590 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c8ac95a3-18bd-4d5b-8e4a-e4fe10997a1c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:09.458841 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c8ac95a3-18bd-4d5b-8e4a-e4fe10997a1c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:09.466781 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c8ac95a3-18bd-4d5b-8e4a-e4fe10997a1c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1278 microversion: 2.1 time: 0.212488 Sep 11 09:01:09.467452 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 605/1188] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:09 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:09.963502 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-eddb70cd-216a-4bbf-aac4-20075fa18ed7 req-6daf0ede-dfb3-461b-9bd3-fad6c4143600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "745fe201-99c8-457b-868b-981e8fd8f368", "tag": "deb2cd1c-eb25-4ef3-a8f1-ed16488a835a"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 09:01:09.973812 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-eddb70cd-216a-4bbf-aac4-20075fa18ed7 req-6daf0ede-dfb3-461b-9bd3-fad6c4143600 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:09.974336 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-eddb70cd-216a-4bbf-aac4-20075fa18ed7 req-6daf0ede-dfb3-461b-9bd3-fad6c4143600 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:09.974766 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-eddb70cd-216a-4bbf-aac4-20075fa18ed7 req-6daf0ede-dfb3-461b-9bd3-fad6c4143600 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:09.986538 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-eddb70cd-216a-4bbf-aac4-20075fa18ed7 req-6daf0ede-dfb3-461b-9bd3-fad6c4143600 service nova] Creating event network-changed:deb2cd1c-eb25-4ef3-a8f1-ed16488a835a for instance 745fe201-99c8-457b-868b-981e8fd8f368 on hv-cinder-85694 Sep 11 09:01:09.992058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-eddb70cd-216a-4bbf-aac4-20075fa18ed7 req-6daf0ede-dfb3-461b-9bd3-fad6c4143600 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033088 Sep 11 09:01:09.992774 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 584/1189] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 09:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 09:01:10.489594 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d613c801-c7b5-428d-a1b4-8ceea8cc8edb tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:10.490235 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d613c801-c7b5-428d-a1b4-8ceea8cc8edb tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:10.496690 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d613c801-c7b5-428d-a1b4-8ceea8cc8edb tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:10.497173 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d613c801-c7b5-428d-a1b4-8ceea8cc8edb tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:10.497612 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d613c801-c7b5-428d-a1b4-8ceea8cc8edb tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:10.498358 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d613c801-c7b5-428d-a1b4-8ceea8cc8edb tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:10.498812 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d613c801-c7b5-428d-a1b4-8ceea8cc8edb tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:10.499239 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d613c801-c7b5-428d-a1b4-8ceea8cc8edb tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:11.052753 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-d613c801-c7b5-428d-a1b4-8ceea8cc8edb tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:11.060567 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d613c801-c7b5-428d-a1b4-8ceea8cc8edb tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1266 microversion: 2.1 time: 0.575173 Sep 11 09:01:11.061194 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 606/1190] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:10 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1266 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:12.088833 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-81aceba3-aa74-44b3-850c-d555911e1ad1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:12.089541 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-81aceba3-aa74-44b3-850c-d555911e1ad1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:12.096818 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81aceba3-aa74-44b3-850c-d555911e1ad1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:12.097293 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81aceba3-aa74-44b3-850c-d555911e1ad1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:12.097725 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81aceba3-aa74-44b3-850c-d555911e1ad1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:12.099034 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81aceba3-aa74-44b3-850c-d555911e1ad1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:12.099483 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81aceba3-aa74-44b3-850c-d555911e1ad1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:12.099902 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-81aceba3-aa74-44b3-850c-d555911e1ad1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:12.234058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-81aceba3-aa74-44b3-850c-d555911e1ad1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:12.242346 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-81aceba3-aa74-44b3-850c-d555911e1ad1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1266 microversion: 2.1 time: 0.161332 Sep 11 09:01:12.242923 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 585/1191] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:12 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:13.265130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b2a009a5-3dfc-414e-8981-b21b3aaa9c76 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:13.265665 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b2a009a5-3dfc-414e-8981-b21b3aaa9c76 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:13.272499 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b2a009a5-3dfc-414e-8981-b21b3aaa9c76 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:13.272977 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b2a009a5-3dfc-414e-8981-b21b3aaa9c76 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:13.273420 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b2a009a5-3dfc-414e-8981-b21b3aaa9c76 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:13.274122 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b2a009a5-3dfc-414e-8981-b21b3aaa9c76 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:13.274604 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b2a009a5-3dfc-414e-8981-b21b3aaa9c76 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:13.275033 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b2a009a5-3dfc-414e-8981-b21b3aaa9c76 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:13.411901 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-b2a009a5-3dfc-414e-8981-b21b3aaa9c76 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:13.419645 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b2a009a5-3dfc-414e-8981-b21b3aaa9c76 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1266 microversion: 2.1 time: 0.158669 Sep 11 09:01:13.420260 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 607/1192] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:13 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:14.442112 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-2233c139-7ea5-4959-b211-d37c91f09da6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:14.442777 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-2233c139-7ea5-4959-b211-d37c91f09da6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:14.449127 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2233c139-7ea5-4959-b211-d37c91f09da6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:14.449617 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2233c139-7ea5-4959-b211-d37c91f09da6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:14.450042 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2233c139-7ea5-4959-b211-d37c91f09da6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:14.450744 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2233c139-7ea5-4959-b211-d37c91f09da6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:14.451193 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2233c139-7ea5-4959-b211-d37c91f09da6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:14.451612 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-2233c139-7ea5-4959-b211-d37c91f09da6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:14.580447 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-2233c139-7ea5-4959-b211-d37c91f09da6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:14.588195 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-2233c139-7ea5-4959-b211-d37c91f09da6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1266 microversion: 2.1 time: 0.150011 Sep 11 09:01:14.588771 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 586/1193] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:14 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:15.610842 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-c6ad226a-ae5d-4dd8-9fd7-90f2c3e3e25c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:15.611434 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-c6ad226a-ae5d-4dd8-9fd7-90f2c3e3e25c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:15.614634 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=2 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:01:15.615305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell0:SELECT=6 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:01:15.619997 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c6ad226a-ae5d-4dd8-9fd7-90f2c3e3e25c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:15.620470 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c6ad226a-ae5d-4dd8-9fd7-90f2c3e3e25c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:15.620902 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c6ad226a-ae5d-4dd8-9fd7-90f2c3e3e25c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:15.621578 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c6ad226a-ae5d-4dd8-9fd7-90f2c3e3e25c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:15.622023 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c6ad226a-ae5d-4dd8-9fd7-90f2c3e3e25c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:15.622471 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-c6ad226a-ae5d-4dd8-9fd7-90f2c3e3e25c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:15.752318 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-c6ad226a-ae5d-4dd8-9fd7-90f2c3e3e25c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:15.760797 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-c6ad226a-ae5d-4dd8-9fd7-90f2c3e3e25c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1266 microversion: 2.1 time: 0.153846 Sep 11 09:01:15.761364 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 608/1194] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:15 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:16.783280 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-be2fbde9-3f38-4d85-b4fe-6a99d1ad0048 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:16.783872 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-be2fbde9-3f38-4d85-b4fe-6a99d1ad0048 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:16.786796 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell0:SELECT=2 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:01:16.791547 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be2fbde9-3f38-4d85-b4fe-6a99d1ad0048 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:16.792024 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be2fbde9-3f38-4d85-b4fe-6a99d1ad0048 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:16.792453 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be2fbde9-3f38-4d85-b4fe-6a99d1ad0048 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:16.793147 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be2fbde9-3f38-4d85-b4fe-6a99d1ad0048 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:16.793672 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be2fbde9-3f38-4d85-b4fe-6a99d1ad0048 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:16.794102 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-be2fbde9-3f38-4d85-b4fe-6a99d1ad0048 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:16.929375 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-be2fbde9-3f38-4d85-b4fe-6a99d1ad0048 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:16.937059 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-be2fbde9-3f38-4d85-b4fe-6a99d1ad0048 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1266 microversion: 2.1 time: 0.157689 Sep 11 09:01:16.937620 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 587/1195] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:16 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:17.960039 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-e67c4690-635e-431a-931c-6a39331d541a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:17.960649 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-e67c4690-635e-431a-931c-6a39331d541a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:17.966977 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e67c4690-635e-431a-931c-6a39331d541a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:17.967452 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e67c4690-635e-431a-931c-6a39331d541a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:17.967885 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e67c4690-635e-431a-931c-6a39331d541a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:17.968564 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e67c4690-635e-431a-931c-6a39331d541a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:17.969010 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e67c4690-635e-431a-931c-6a39331d541a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:17.969427 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-e67c4690-635e-431a-931c-6a39331d541a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:18.104227 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-e67c4690-635e-431a-931c-6a39331d541a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:18.112128 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-e67c4690-635e-431a-931c-6a39331d541a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1266 microversion: 2.1 time: 0.156620 Sep 11 09:01:18.112697 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 609/1196] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:17 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:19.136271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-3bbb6cdb-cceb-469a-90eb-efa37a9c077c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:19.136874 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-3bbb6cdb-cceb-469a-90eb-efa37a9c077c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:19.143484 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bbb6cdb-cceb-469a-90eb-efa37a9c077c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:19.143971 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bbb6cdb-cceb-469a-90eb-efa37a9c077c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:19.144410 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bbb6cdb-cceb-469a-90eb-efa37a9c077c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:19.145119 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bbb6cdb-cceb-469a-90eb-efa37a9c077c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:19.145575 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bbb6cdb-cceb-469a-90eb-efa37a9c077c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:19.146003 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-3bbb6cdb-cceb-469a-90eb-efa37a9c077c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:19.281166 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-3bbb6cdb-cceb-469a-90eb-efa37a9c077c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:19.289530 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-3bbb6cdb-cceb-469a-90eb-efa37a9c077c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1266 microversion: 2.1 time: 0.158262 Sep 11 09:01:19.304547 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 588/1197] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:19 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:20.312204 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-2d721dda-bcea-4144-bea5-5364d2f9410a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:20.312814 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-2d721dda-bcea-4144-bea5-5364d2f9410a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:20.319920 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2d721dda-bcea-4144-bea5-5364d2f9410a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:20.320400 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2d721dda-bcea-4144-bea5-5364d2f9410a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:20.320831 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2d721dda-bcea-4144-bea5-5364d2f9410a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:20.321507 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2d721dda-bcea-4144-bea5-5364d2f9410a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:20.321956 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2d721dda-bcea-4144-bea5-5364d2f9410a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:20.322399 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-2d721dda-bcea-4144-bea5-5364d2f9410a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:20.451624 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-2d721dda-bcea-4144-bea5-5364d2f9410a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:20.459228 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-2d721dda-bcea-4144-bea5-5364d2f9410a tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1266 microversion: 2.1 time: 0.150985 Sep 11 09:01:20.459794 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 610/1198] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:20 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:21.345158 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-97437650-dde7-4102-b989-b15b354d49b2 req-e1a68bf1-3afd-4fee-b43c-bdf636051490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745fe201-99c8-457b-868b-981e8fd8f368", "name": "network-vif-plugged", "status": "completed", "tag": "deb2cd1c-eb25-4ef3-a8f1-ed16488a835a"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 09:01:21.356313 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-97437650-dde7-4102-b989-b15b354d49b2 req-e1a68bf1-3afd-4fee-b43c-bdf636051490 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:21.356313 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-97437650-dde7-4102-b989-b15b354d49b2 req-e1a68bf1-3afd-4fee-b43c-bdf636051490 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:21.356618 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-97437650-dde7-4102-b989-b15b354d49b2 req-e1a68bf1-3afd-4fee-b43c-bdf636051490 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:21.369137 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-97437650-dde7-4102-b989-b15b354d49b2 req-e1a68bf1-3afd-4fee-b43c-bdf636051490 service nova] Creating event network-vif-plugged:deb2cd1c-eb25-4ef3-a8f1-ed16488a835a for instance 745fe201-99c8-457b-868b-981e8fd8f368 on hv-cinder-85694 Sep 11 09:01:21.374456 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-97437650-dde7-4102-b989-b15b354d49b2 req-e1a68bf1-3afd-4fee-b43c-bdf636051490 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033148 Sep 11 09:01:21.375041 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 589/1199] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 09:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 09:01:21.482464 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5dc1be67-d36d-4342-87bc-8fef7d52320c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:21.483245 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5dc1be67-d36d-4342-87bc-8fef7d52320c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:21.490747 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5dc1be67-d36d-4342-87bc-8fef7d52320c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:21.491249 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5dc1be67-d36d-4342-87bc-8fef7d52320c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:21.491769 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5dc1be67-d36d-4342-87bc-8fef7d52320c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:21.492697 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5dc1be67-d36d-4342-87bc-8fef7d52320c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:21.493159 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5dc1be67-d36d-4342-87bc-8fef7d52320c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:21.493592 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5dc1be67-d36d-4342-87bc-8fef7d52320c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:21.630921 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5dc1be67-d36d-4342-87bc-8fef7d52320c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:21.638772 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5dc1be67-d36d-4342-87bc-8fef7d52320c tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1266 microversion: 2.1 time: 0.160301 Sep 11 09:01:21.639356 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 611/1200] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:21 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:22.663825 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-413b2683-f6c4-4cfe-b5a9-c1a3de9d4667 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:22.664539 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-413b2683-f6c4-4cfe-b5a9-c1a3de9d4667 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:22.670650 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413b2683-f6c4-4cfe-b5a9-c1a3de9d4667 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:22.671129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413b2683-f6c4-4cfe-b5a9-c1a3de9d4667 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:22.671558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413b2683-f6c4-4cfe-b5a9-c1a3de9d4667 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:22.672296 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413b2683-f6c4-4cfe-b5a9-c1a3de9d4667 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:22.672749 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413b2683-f6c4-4cfe-b5a9-c1a3de9d4667 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:22.673156 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-413b2683-f6c4-4cfe-b5a9-c1a3de9d4667 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:22.810955 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-413b2683-f6c4-4cfe-b5a9-c1a3de9d4667 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:22.818986 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-413b2683-f6c4-4cfe-b5a9-c1a3de9d4667 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1266 microversion: 2.1 time: 0.160375 Sep 11 09:01:22.820111 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 590/1201] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:22 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:23.842401 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-fa812882-290e-49c2-bddf-f190b3f1b0c7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:23.843015 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-fa812882-290e-49c2-bddf-f190b3f1b0c7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:23.850004 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa812882-290e-49c2-bddf-f190b3f1b0c7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:23.850506 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa812882-290e-49c2-bddf-f190b3f1b0c7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:23.850939 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa812882-290e-49c2-bddf-f190b3f1b0c7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:23.851620 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa812882-290e-49c2-bddf-f190b3f1b0c7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:23.852068 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa812882-290e-49c2-bddf-f190b3f1b0c7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:23.852486 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-fa812882-290e-49c2-bddf-f190b3f1b0c7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:23.983906 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-fa812882-290e-49c2-bddf-f190b3f1b0c7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:23.991860 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-fa812882-290e-49c2-bddf-f190b3f1b0c7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1452 microversion: 2.1 time: 0.153414 Sep 11 09:01:23.992430 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 612/1202] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:23 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:01:24.013655 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-e016528c-6ef4-473f-8ec8-9f42122d4ecc tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:01:24.019453 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-e016528c-6ef4-473f-8ec8-9f42122d4ecc tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:01:24.021221 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e016528c-6ef4-473f-8ec8-9f42122d4ecc tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:24.021698 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e016528c-6ef4-473f-8ec8-9f42122d4ecc tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:24.022236 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e016528c-6ef4-473f-8ec8-9f42122d4ecc tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:24.022863 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e016528c-6ef4-473f-8ec8-9f42122d4ecc tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:24.023314 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e016528c-6ef4-473f-8ec8-9f42122d4ecc tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:24.023727 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-e016528c-6ef4-473f-8ec8-9f42122d4ecc tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:24.152384 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-e016528c-6ef4-473f-8ec8-9f42122d4ecc tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:01:24.159895 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-e016528c-6ef4-473f-8ec8-9f42122d4ecc tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1452 microversion: 2.1 time: 0.150250 Sep 11 09:01:24.160483 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 591/1203] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:01:24 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 09:01:26.004568 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-fe3fd07a-559f-4084-bf59-68d888377a10 req-5697489f-45c5-420f-be9c-b3fca4487b6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "745fe201-99c8-457b-868b-981e8fd8f368", "tag": "deb2cd1c-eb25-4ef3-a8f1-ed16488a835a"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 09:01:26.014073 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-fe3fd07a-559f-4084-bf59-68d888377a10 req-5697489f-45c5-420f-be9c-b3fca4487b6f service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:01:26.015209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-fe3fd07a-559f-4084-bf59-68d888377a10 req-5697489f-45c5-420f-be9c-b3fca4487b6f service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:01:26.015209 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-fe3fd07a-559f-4084-bf59-68d888377a10 req-5697489f-45c5-420f-be9c-b3fca4487b6f service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:01:26.028023 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-fe3fd07a-559f-4084-bf59-68d888377a10 req-5697489f-45c5-420f-be9c-b3fca4487b6f service nova] Creating event network-changed:deb2cd1c-eb25-4ef3-a8f1-ed16488a835a for instance 745fe201-99c8-457b-868b-981e8fd8f368 on hv-cinder-85694 Sep 11 09:01:26.033182 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-fe3fd07a-559f-4084-bf59-68d888377a10 req-5697489f-45c5-420f-be9c-b3fca4487b6f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032714 Sep 11 09:01:26.034283 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 613/1204] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 09:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 09:02:56.368469 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR oslo.messaging._drivers.impl_rabbit [-] [98add9c5-c214-4863-87f2-f698ee33ad04] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 11 09:02:56.372056 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:02:56.372717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-fa1d0c90-d9d4-4439-a9b4-9f361e0b0c7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:02:56.373086 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG dbcounter [-] [127646] Writing DB stats nova_cell1:SELECT=58 {{(pid=127646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:02:56.373207 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-fa1d0c90-d9d4-4439-a9b4-9f361e0b0c7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:02:56.375412 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_api:SELECT=22 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:02:56.376067 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG dbcounter [-] [127647] Writing DB stats nova_cell1:SELECT=46 {{(pid=127647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 09:02:56.376906 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 11 09:02:56.377058 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Sun Sep 11 09:02:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 (ip 10.222.0.44) !!! Sep 11 09:02:56.386396 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fa1d0c90-d9d4-4439-a9b4-9f361e0b0c7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:02:56.386954 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fa1d0c90-d9d4-4439-a9b4-9f361e0b0c7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:02:56.387460 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fa1d0c90-d9d4-4439-a9b4-9f361e0b0c7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:02:56.388238 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fa1d0c90-d9d4-4439-a9b4-9f361e0b0c7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:02:56.388765 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fa1d0c90-d9d4-4439-a9b4-9f361e0b0c7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:02:56.389565 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fa1d0c90-d9d4-4439-a9b4-9f361e0b0c7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:02:56.418179 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-fa1d0c90-d9d4-4439-a9b4-9f361e0b0c7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Going to try to terminate instance {{(pid=127647) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 09:02:56.514848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-d084f01a-ceb4-4b44-a0a3-21a2180f8b36 req-701056cb-543e-49e7-8d12-9abe7c727f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "745fe201-99c8-457b-868b-981e8fd8f368", "tag": "deb2cd1c-eb25-4ef3-a8f1-ed16488a835a"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 09:02:56.525668 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d084f01a-ceb4-4b44-a0a3-21a2180f8b36 req-701056cb-543e-49e7-8d12-9abe7c727f04 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:02:56.529610 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d084f01a-ceb4-4b44-a0a3-21a2180f8b36 req-701056cb-543e-49e7-8d12-9abe7c727f04 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:02:56.529610 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-d084f01a-ceb4-4b44-a0a3-21a2180f8b36 req-701056cb-543e-49e7-8d12-9abe7c727f04 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:02:56.538546 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-d084f01a-ceb4-4b44-a0a3-21a2180f8b36 req-701056cb-543e-49e7-8d12-9abe7c727f04 service nova] Creating event network-changed:deb2cd1c-eb25-4ef3-a8f1-ed16488a835a for instance 745fe201-99c8-457b-868b-981e8fd8f368 on hv-cinder-85694 Sep 11 09:02:56.543650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-d084f01a-ceb4-4b44-a0a3-21a2180f8b36 req-701056cb-543e-49e7-8d12-9abe7c727f04 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173799 Sep 11 09:02:56.544252 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 614/1205] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 09:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 09:02:56.728034 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-fa1d0c90-d9d4-4439-a9b4-9f361e0b0c7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "DELETE /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 204 len: 0 microversion: 2.1 time: 0.361182 Sep 11 09:02:56.728894 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 592/1206] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 09:02:56 2022] DELETE /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 09:02:56.738273 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-81bc0d2b-5aea-4f7f-b491-cece6e5abb9b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:02:56.739273 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-81bc0d2b-5aea-4f7f-b491-cece6e5abb9b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:02:56.747543 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81bc0d2b-5aea-4f7f-b491-cece6e5abb9b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:02:56.748387 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81bc0d2b-5aea-4f7f-b491-cece6e5abb9b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:02:56.749051 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81bc0d2b-5aea-4f7f-b491-cece6e5abb9b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:02:56.749868 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81bc0d2b-5aea-4f7f-b491-cece6e5abb9b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:02:56.750610 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81bc0d2b-5aea-4f7f-b491-cece6e5abb9b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:02:56.751110 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-81bc0d2b-5aea-4f7f-b491-cece6e5abb9b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:02:56.951824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-81bc0d2b-5aea-4f7f-b491-cece6e5abb9b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:02:56.959845 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-81bc0d2b-5aea-4f7f-b491-cece6e5abb9b tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1577 microversion: 2.1 time: 0.226665 Sep 11 09:02:56.960436 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 615/1207] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:02:56 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:02:57.983944 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-629596ce-f760-4fe3-ac10-cf4182376e30 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:02:57.984683 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-629596ce-f760-4fe3-ac10-cf4182376e30 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:02:57.994407 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-629596ce-f760-4fe3-ac10-cf4182376e30 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:02:57.994901 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-629596ce-f760-4fe3-ac10-cf4182376e30 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:02:57.995348 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-629596ce-f760-4fe3-ac10-cf4182376e30 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:02:57.996114 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-629596ce-f760-4fe3-ac10-cf4182376e30 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:02:57.996571 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-629596ce-f760-4fe3-ac10-cf4182376e30 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:02:57.996999 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-629596ce-f760-4fe3-ac10-cf4182376e30 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:02:58.002486 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO oslo.messaging._drivers.impl_rabbit [-] [98add9c5-c214-4863-87f2-f698ee33ad04] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 51050. Sep 11 09:02:58.185525 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-629596ce-f760-4fe3-ac10-cf4182376e30 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:02:58.193693 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-629596ce-f760-4fe3-ac10-cf4182376e30 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1577 microversion: 2.1 time: 0.213991 Sep 11 09:02:58.194437 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 593/1208] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:02:57 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 09:02:59.041660 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [req-a7227ecf-c578-459a-98d2-6b5ddeeef8ab req-87dc82fa-7a17-404e-88f2-7f23e2f96a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "745fe201-99c8-457b-868b-981e8fd8f368", "name": "network-vif-deleted", "tag": "deb2cd1c-eb25-4ef3-a8f1-ed16488a835a"}]} {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 09:02:59.051616 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-a7227ecf-c578-459a-98d2-6b5ddeeef8ab req-87dc82fa-7a17-404e-88f2-7f23e2f96a10 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:02:59.053748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-a7227ecf-c578-459a-98d2-6b5ddeeef8ab req-87dc82fa-7a17-404e-88f2-7f23e2f96a10 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:02:59.053748 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [req-a7227ecf-c578-459a-98d2-6b5ddeeef8ab req-87dc82fa-7a17-404e-88f2-7f23e2f96a10 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:02:59.063900 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.compute.server_external_events [req-a7227ecf-c578-459a-98d2-6b5ddeeef8ab req-87dc82fa-7a17-404e-88f2-7f23e2f96a10 service nova] Creating event network-vif-deleted:deb2cd1c-eb25-4ef3-a8f1-ed16488a835a for instance 745fe201-99c8-457b-868b-981e8fd8f368 on hv-cinder-85694 Sep 11 09:02:59.069860 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [req-a7227ecf-c578-459a-98d2-6b5ddeeef8ab req-87dc82fa-7a17-404e-88f2-7f23e2f96a10 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031901 Sep 11 09:02:59.070503 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 616/1209] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 09:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 11 09:02:59.216891 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-32628cba-34fa-42e3-bdc9-42604a41a4f1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:02:59.217497 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-32628cba-34fa-42e3-bdc9-42604a41a4f1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:02:59.223974 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32628cba-34fa-42e3-bdc9-42604a41a4f1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:02:59.224402 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32628cba-34fa-42e3-bdc9-42604a41a4f1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:02:59.224833 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32628cba-34fa-42e3-bdc9-42604a41a4f1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:02:59.226027 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32628cba-34fa-42e3-bdc9-42604a41a4f1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:02:59.226519 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32628cba-34fa-42e3-bdc9-42604a41a4f1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:02:59.226949 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-32628cba-34fa-42e3-bdc9-42604a41a4f1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:02:59.304111 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-32628cba-34fa-42e3-bdc9-42604a41a4f1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:02:59.312111 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-32628cba-34fa-42e3-bdc9-42604a41a4f1 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1225 microversion: 2.1 time: 0.099154 Sep 11 09:02:59.312678 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 594/1210] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:02:59 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:03:00.350257 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:03:00.350967 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:03:00.357583 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:00.359712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:00.359712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:00.359712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:00.359712 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:00.360257 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:00.396186 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:00.396676 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:00.397120 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:00.397574 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.objects.instance [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lazy-loading 'fault' on Instance uuid 745fe201-99c8-457b-868b-981e8fd8f368 {{(pid=127646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 09:03:00.440050 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:03:00.448573 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-5ab8fdbd-a4cd-42ac-b34d-963383394751 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 200 len: 1230 microversion: 2.1 time: 0.102858 Sep 11 09:03:00.449182 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 617/1211] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:03:00 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:03:01.476734 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:03:01.477349 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 745fe201-99c8-457b-868b-981e8fd8f368] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:03:01.483956 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:01.484443 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:01.484867 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:01.485558 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:01.486002 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:01.486445 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:01.500561 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] HTTP exception thrown: Instance 745fe201-99c8-457b-868b-981e8fd8f368 could not be found. Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Request method failure captured: Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 HTTP/1.1 Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaKclZkxep2bvXUZ3mXjjayTCi4aM7DS5TUnDAJzwpjdmNBfR7lhFNF4tfu8iaLW3X0NwFw-CKCMqMmoh248yGgDvC8jjJT03GGzogRSpZV0yLHBmJMcTxoxuhn9llEHGWYekCaEIrYnV4UE0kFAe7mLCy1Mz3HMofiY-st1aOtf7dQ Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 6d5504106ccb4549b09f29d7104d9b0a Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 09:03:01.502271 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6d5504106ccb4549b09f29d7104d9b0a", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 6d5504106ccb4549b09f29d7104d9b0a Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-TestVolumeBootPattern-830871099-project Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: ed50f5d8261d44b487390de092ef9136 Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-TestVolumeBootPattern-830871099-project Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance 745fe201-99c8-457b-868b-981e8fd8f368 could not be found. Sep 11 09:03:01.504046 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': '745fe201-99c8-457b-868b-981e8fd8f368'} Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 745fe201-99c8-457b-868b-981e8fd8f368 could not be found. Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 09:03:01.505129 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 745fe201-99c8-457b-868b-981e8fd8f368 could not be found. Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 745fe201-99c8-457b-868b-981e8fd8f368 could not be found. Sep 11 09:03:01.507446 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 09:03:01.509053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Returning 404 to user: Instance 745fe201-99c8-457b-868b-981e8fd8f368 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 09:03:01.509053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-5ed9fb9e-1c72-4e94-93a9-4c97a643e23e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368" status: 404 len: 111 microversion: 2.1 time: 0.030841 Sep 11 09:03:01.509053 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 595/1212] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:03:01 2022] GET /compute/v2.1/servers/745fe201-99c8-457b-868b-981e8fd8f368 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 09:03:04.781077 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-b0e0055e-fb65-41fa-892f-34a8f75db2ae tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:03:04.781568 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b0e0055e-fb65-41fa-892f-34a8f75db2ae tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:03:04.788361 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0e0055e-fb65-41fa-892f-34a8f75db2ae tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:04.788856 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0e0055e-fb65-41fa-892f-34a8f75db2ae tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:04.789424 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0e0055e-fb65-41fa-892f-34a8f75db2ae tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:04.789549 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-14efecd4-e4a2-4125-820a-2fd34927d374 req-4b5f5663-ef87-4206-a159-19973d147298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c75c57-4b25-4562-bb8e-3475d82d8a18", "tag": "27d73c4c-bc09-4824-ae90-fa59d3d43c5f"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 09:03:04.790754 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0e0055e-fb65-41fa-892f-34a8f75db2ae tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:04.791221 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0e0055e-fb65-41fa-892f-34a8f75db2ae tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:04.791650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-b0e0055e-fb65-41fa-892f-34a8f75db2ae tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:04.799409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-14efecd4-e4a2-4125-820a-2fd34927d374 req-4b5f5663-ef87-4206-a159-19973d147298 service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:04.799894 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-14efecd4-e4a2-4125-820a-2fd34927d374 req-4b5f5663-ef87-4206-a159-19973d147298 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:04.800325 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-14efecd4-e4a2-4125-820a-2fd34927d374 req-4b5f5663-ef87-4206-a159-19973d147298 service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:04.812204 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-14efecd4-e4a2-4125-820a-2fd34927d374 req-4b5f5663-ef87-4206-a159-19973d147298 service nova] Creating event network-changed:27d73c4c-bc09-4824-ae90-fa59d3d43c5f for instance 18c75c57-4b25-4562-bb8e-3475d82d8a18 on hv-cinder-85694 Sep 11 09:03:04.817421 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-14efecd4-e4a2-4125-820a-2fd34927d374 req-4b5f5663-ef87-4206-a159-19973d147298 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031465 Sep 11 09:03:04.818880 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 596/1213] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 09:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 09:03:04.821056 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-b0e0055e-fb65-41fa-892f-34a8f75db2ae tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Going to try to terminate instance {{(pid=127646) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 11 09:03:05.071129 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-b0e0055e-fb65-41fa-892f-34a8f75db2ae tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "DELETE /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 204 len: 0 microversion: 2.1 time: 0.293754 Sep 11 09:03:05.072317 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 618/1214] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 09:03:04 2022] DELETE /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 11 09:03:05.081297 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-fbe778f2-80d1-4ed0-8573-d93e55ec40ed tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:03:05.082305 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-fbe778f2-80d1-4ed0-8573-d93e55ec40ed tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:03:05.088801 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbe778f2-80d1-4ed0-8573-d93e55ec40ed tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:05.089300 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbe778f2-80d1-4ed0-8573-d93e55ec40ed tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:05.089740 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbe778f2-80d1-4ed0-8573-d93e55ec40ed tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:05.090516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbe778f2-80d1-4ed0-8573-d93e55ec40ed tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:05.091184 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbe778f2-80d1-4ed0-8573-d93e55ec40ed tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:05.092679 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-fbe778f2-80d1-4ed0-8573-d93e55ec40ed tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:05.229552 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-fbe778f2-80d1-4ed0-8573-d93e55ec40ed tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:03:05.237493 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-fbe778f2-80d1-4ed0-8573-d93e55ec40ed tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1578 microversion: 2.1 time: 0.160501 Sep 11 09:03:05.238140 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 597/1215] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:03:05 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 11 09:03:06.261807 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-cfbfb125-8514-41e1-a412-46d47608b915 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:03:06.262824 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-cfbfb125-8514-41e1-a412-46d47608b915 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:03:06.269173 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cfbfb125-8514-41e1-a412-46d47608b915 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:06.269689 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cfbfb125-8514-41e1-a412-46d47608b915 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:06.270122 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cfbfb125-8514-41e1-a412-46d47608b915 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:06.271501 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cfbfb125-8514-41e1-a412-46d47608b915 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:06.271957 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cfbfb125-8514-41e1-a412-46d47608b915 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:06.272377 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-cfbfb125-8514-41e1-a412-46d47608b915 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:06.408533 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-cfbfb125-8514-41e1-a412-46d47608b915 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:03:06.416313 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-cfbfb125-8514-41e1-a412-46d47608b915 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1578 microversion: 2.1 time: 0.158729 Sep 11 09:03:06.416886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 619/1216] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:03:06 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:03:07.355912 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [req-c0a87945-fc53-4ad9-a716-de1c99e514cb req-659fca10-68ed-4550-a3a1-ec1fa190422d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c75c57-4b25-4562-bb8e-3475d82d8a18", "name": "network-vif-deleted", "tag": "27d73c4c-bc09-4824-ae90-fa59d3d43c5f"}]} {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 11 09:03:07.368395 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-c0a87945-fc53-4ad9-a716-de1c99e514cb req-659fca10-68ed-4550-a3a1-ec1fa190422d service nova] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:07.368872 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-c0a87945-fc53-4ad9-a716-de1c99e514cb req-659fca10-68ed-4550-a3a1-ec1fa190422d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:07.369296 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [req-c0a87945-fc53-4ad9-a716-de1c99e514cb req-659fca10-68ed-4550-a3a1-ec1fa190422d service nova] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:07.382054 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.compute.server_external_events [req-c0a87945-fc53-4ad9-a716-de1c99e514cb req-659fca10-68ed-4550-a3a1-ec1fa190422d service nova] Creating event network-vif-deleted:27d73c4c-bc09-4824-ae90-fa59d3d43c5f for instance 18c75c57-4b25-4562-bb8e-3475d82d8a18 on hv-cinder-85694 Sep 11 09:03:07.387159 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [req-c0a87945-fc53-4ad9-a716-de1c99e514cb req-659fca10-68ed-4550-a3a1-ec1fa190422d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034956 Sep 11 09:03:07.387685 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 598/1217] 10.222.0.44 () {64 vars in 1317 bytes} [Sun Sep 11 09:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 11 09:03:07.440563 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-9c398ced-b610-4635-ba61-415b06ba1a07 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:03:07.441298 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-9c398ced-b610-4635-ba61-415b06ba1a07 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:03:07.448396 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9c398ced-b610-4635-ba61-415b06ba1a07 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:07.449051 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9c398ced-b610-4635-ba61-415b06ba1a07 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:07.449490 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9c398ced-b610-4635-ba61-415b06ba1a07 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:07.450206 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9c398ced-b610-4635-ba61-415b06ba1a07 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:07.450660 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9c398ced-b610-4635-ba61-415b06ba1a07 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:07.451080 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-9c398ced-b610-4635-ba61-415b06ba1a07 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:07.517758 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.policy [None req-9c398ced-b610-4635-ba61-415b06ba1a07 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127646) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:03:07.526109 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-9c398ced-b610-4635-ba61-415b06ba1a07 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1391 microversion: 2.1 time: 0.089478 Sep 11 09:03:07.526825 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 620/1218] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:03:07 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1391 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:03:08.551416 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:03:08.552127 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:03:08.558359 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:08.562282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:08.562282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:08.562282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:08.562282 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:08.562660 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:08.594750 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:08.595709 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:08.595709 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:08.596019 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.objects.instance [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lazy-loading 'fault' on Instance uuid 18c75c57-4b25-4562-bb8e-3475d82d8a18 {{(pid=127647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 11 09:03:08.640512 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.policy [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed50f5d8261d44b487390de092ef9136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5504106ccb4549b09f29d7104d9b0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127647) authorize /opt/stack/nova/nova/policy.py:199}} Sep 11 09:03:08.647907 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-13db6289-e3e0-49a8-ac8c-7b90eacbd8b6 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 200 len: 1184 microversion: 2.1 time: 0.101380 Sep 11 09:03:08.648691 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 599/1219] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:03:08 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 1184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 11 09:03:09.670946 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:03:09.671584 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: 18c75c57-4b25-4562-bb8e-3475d82d8a18] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:03:09.677924 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:09.678438 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:09.678877 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:09.679580 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:09.680027 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:09.680447 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:09.694447 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] HTTP exception thrown: Instance 18c75c57-4b25-4562-bb8e-3475d82d8a18 could not be found. Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Request method failure captured: Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 HTTP/1.1 Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaKclZkxep2bvXUZ3mXjjayTCi4aM7DS5TUnDAJzwpjdmNBfR7lhFNF4tfu8iaLW3X0NwFw-CKCMqMmoh248yGgDvC8jjJT03GGzogRSpZV0yLHBmJMcTxoxuhn9llEHGWYekCaEIrYnV4UE0kFAe7mLCy1Mz3HMofiY-st1aOtf7dQ Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 6d5504106ccb4549b09f29d7104d9b0a Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 09:03:09.696130 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6d5504106ccb4549b09f29d7104d9b0a", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 6d5504106ccb4549b09f29d7104d9b0a Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-TestVolumeBootPattern-830871099-project Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: ed50f5d8261d44b487390de092ef9136 Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-TestVolumeBootPattern-830871099-project Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance 18c75c57-4b25-4562-bb8e-3475d82d8a18 could not be found. Sep 11 09:03:09.697670 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': '18c75c57-4b25-4562-bb8e-3475d82d8a18'} Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c75c57-4b25-4562-bb8e-3475d82d8a18 could not be found. Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 09:03:09.703848 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c75c57-4b25-4562-bb8e-3475d82d8a18 could not be found. Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c75c57-4b25-4562-bb8e-3475d82d8a18 could not be found. Sep 11 09:03:09.705617 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 09:03:09.706886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Returning 404 to user: Instance 18c75c57-4b25-4562-bb8e-3475d82d8a18 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 09:03:09.706886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-d4c7ba37-b949-4d1c-880d-d83de0b7d7b0 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18" status: 404 len: 111 microversion: 2.1 time: 0.030520 Sep 11 09:03:09.706886 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 621/1220] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:03:09 2022] GET /compute/v2.1/servers/18c75c57-4b25-4562-bb8e-3475d82d8a18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 09:03:10.235007 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:03:10.235516 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.compute.api [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127647) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:03:10.242600 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:10.243076 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:10.243604 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:10.244194 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:10.244665 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:10.245078 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG oslo_concurrency.lockutils [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:10.258988 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.wsgi [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] HTTP exception thrown: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Request method failure captured: Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: request: DELETE /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 HTTP/1.1 Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept: application/json Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Accept-Encoding: identity Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Connection: close Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Length: 0 Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Content-Type: application/json Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Host: 10.222.0.44 Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: Openstack-System-Scope: None Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: User-Agent: python-urllib3/1.26.12 Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Auth-Token: gAAAAABjHaKclZkxep2bvXUZ3mXjjayTCi4aM7DS5TUnDAJzwpjdmNBfR7lhFNF4tfu8iaLW3X0NwFw-CKCMqMmoh248yGgDvC8jjJT03GGzogRSpZV0yLHBmJMcTxoxuhn9llEHGWYekCaEIrYnV4UE0kFAe7mLCy1Mz3HMofiY-st1aOtf7dQ Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Id: None Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Domain-Name: None Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Identity-Status: Confirmed Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Is-Admin-Project: True Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Id: default Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Domain-Name: Default Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Id: 6d5504106ccb4549b09f29d7104d9b0a Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Project-Name: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Role: reader,member Sep 11 09:03:10.260647 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Roles: reader,member Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6d5504106ccb4549b09f29d7104d9b0a", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Id: 6d5504106ccb4549b09f29d7104d9b0a Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-Tenant-Name: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User: tempest-TestVolumeBootPattern-830871099-project Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Id: default Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Domain-Name: Default Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Id: ed50f5d8261d44b487390de092ef9136 Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: X-User-Name: tempest-TestVolumeBootPattern-830871099-project Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: method: > Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: exception: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 09:03:10.262409 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: action_args: {'id': 'd102028f-9e13-426e-ae8e-dfc13f6ea147'} Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 09:03:10.263370 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 09:03:10.264717 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: ERROR nova.api.openstack.wsgi Sep 11 09:03:10.266085 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Returning 404 to user: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. {{(pid=127647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 09:03:10.266085 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-ec10476e-d87b-47e9-b271-5cbd178abf7e tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 404 len: 111 microversion: 2.1 time: 0.030964 Sep 11 09:03:10.266085 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 600/1221] 10.222.0.44 () {58 vars in 1239 bytes} [Sun Sep 11 09:03:10 2022] DELETE /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 11 09:03:10.270743 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '>' {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:03:10.271359 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.compute.api [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] [instance: d102028f-9e13-426e-ae8e-dfc13f6ea147] Fetching instance by UUID {{(pid=127646) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 11 09:03:10.277342 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:10.277822 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:10.278305 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:10.278993 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Acquiring lock "382ca797-322f-42ed-b065-8d7753b9f2b1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 11 09:03:10.279448 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 11 09:03:10.279873 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG oslo_concurrency.lockutils [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Lock "382ca797-322f-42ed-b065-8d7753b9f2b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 11 09:03:10.293098 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.wsgi [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] HTTP exception thrown: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Request method failure captured: Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: request: GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 HTTP/1.1 Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept: application/json Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Accept-Encoding: identity Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Connection: close Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Length: 0 Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Content-Type: application/json Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Host: 10.222.0.44 Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: Openstack-System-Scope: None Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: User-Agent: python-urllib3/1.26.12 Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Auth-Token: gAAAAABjHaKclZkxep2bvXUZ3mXjjayTCi4aM7DS5TUnDAJzwpjdmNBfR7lhFNF4tfu8iaLW3X0NwFw-CKCMqMmoh248yGgDvC8jjJT03GGzogRSpZV0yLHBmJMcTxoxuhn9llEHGWYekCaEIrYnV4UE0kFAe7mLCy1Mz3HMofiY-st1aOtf7dQ Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Id: None Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Domain-Name: None Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Identity-Status: Confirmed Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Is-Admin-Project: True Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Id: default Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Domain-Name: Default Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Id: 6d5504106ccb4549b09f29d7104d9b0a Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Project-Name: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Role: reader,member Sep 11 09:03:10.294650 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Roles: reader,member Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6d5504106ccb4549b09f29d7104d9b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6d5504106ccb4549b09f29d7104d9b0a", "adminURL": "http://10.222.0.44:8080"}]}] Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Id: 6d5504106ccb4549b09f29d7104d9b0a Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-Tenant-Name: tempest-TestVolumeBootPattern-830871099 Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User: tempest-TestVolumeBootPattern-830871099-project Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Id: default Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Domain-Name: Default Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Id: ed50f5d8261d44b487390de092ef9136 Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: X-User-Name: tempest-TestVolumeBootPattern-830871099-project Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: method: > Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: exception: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 09:03:10.296444 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: action_args: {'id': 'd102028f-9e13-426e-ae8e-dfc13f6ea147'} Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: {{(pid=127646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 11 09:03:10.297335 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. Sep 11 09:03:10.298947 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: ERROR nova.api.openstack.wsgi Sep 11 09:03:10.300393 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: DEBUG nova.api.openstack.wsgi [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Returning 404 to user: Instance d102028f-9e13-426e-ae8e-dfc13f6ea147 could not be found. {{(pid=127646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 11 09:03:10.300393 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: INFO nova.api.openstack.requestlog [None req-99ccbc0f-881d-4d7e-b9a0-102d6afc7bb7 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147" status: 404 len: 111 microversion: 2.1 time: 0.029211 Sep 11 09:03:10.300393 dv-cinder-856941-2-iscsi devstack@n-api.service[127646]: [pid: 127646|app: 0|req: 622/1222] 10.222.0.44 () {58 vars in 1236 bytes} [Sun Sep 11 09:03:10 2022] GET /compute/v2.1/servers/d102028f-9e13-426e-ae8e-dfc13f6ea147 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 11 09:03:11.829678 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: DEBUG nova.api.openstack.wsgi [None req-6de9582f-8895-4238-b426-36942b45b849 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] Calling method '.version_select at 0x7fb27ee74b80>' {{(pid=127647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 11 09:03:11.928511 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: INFO nova.api.openstack.requestlog [None req-6de9582f-8895-4238-b426-36942b45b849 tempest-TestVolumeBootPattern-830871099 tempest-TestVolumeBootPattern-830871099-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-425546129" status: 202 len: 0 microversion: 2.1 time: 0.102119 Sep 11 09:03:11.929091 dv-cinder-856941-2-iscsi devstack@n-api.service[127647]: [pid: 127647|app: 0|req: 601/1223] 10.222.0.44 () {58 vars in 1260 bytes} [Sun Sep 11 09:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-425546129 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)